-- Logs begin at Thu 2022-09-01 07:35:07 UTC, end at Thu 2022-09-01 09:10:30 UTC. -- Sep 01 08:06:54.670479 dv-cinder-855479-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 08:06:54.681610 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 08:06:54 2022] *** Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: nodename: dv-cinder-855479-1-iscsi Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: machine: x86_64 Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: clock source: unix Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: pcre jit disabled Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: detected number of CPU cores: 4 Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: current working directory: / Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: detected binary path: /usr/bin/uwsgi-core Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: your processes number limit is 47680 Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: your memory page size is 4096 bytes Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: detected max file descriptor number: 2048 Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: lock engine: pthread robust mutexes Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: thunder lock: enabled Sep 01 08:06:54.685143 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 08:06:54.686080 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 08:06:54.723449 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: Python main interpreter initialized at 0x55c3cbe779c0 Sep 01 08:06:54.723449 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: python threads support enabled Sep 01 08:06:54.723449 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: your server socket listen backlog is limited to 100 connections Sep 01 08:06:54.723449 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: your mercy for graceful operations on workers is 90 seconds Sep 01 08:06:54.723831 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 08:06:54.723831 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: *** Operational MODE: preforking *** Sep 01 08:06:54.724064 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: *** uWSGI is running in multiple interpreter mode *** Sep 01 08:06:54.724064 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: spawned uWSGI master process (pid: 105718) Sep 01 08:06:54.724277 dv-cinder-855479-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 08:06:54.726524 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: spawned uWSGI worker 1 (pid: 105719, cores: 1) Sep 01 08:06:54.726524 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: spawned uWSGI worker 2 (pid: 105720, cores: 1) Sep 01 08:06:54.726524 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 08:06:55.397924 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 08:06:55.398761 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 08:06:56.511293 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:06:56.511293 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: from cryptography.utils import int_from_bytes Sep 01 08:06:56.511941 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:06:56.511941 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: from cryptography.utils import int_from_bytes Sep 01 08:06:56.514800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:06:56.514800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: from cryptography.utils import int_from_bytes Sep 01 08:06:56.515252 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:06:56.515252 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: from cryptography.utils import int_from_bytes Sep 01 08:06:59.041473 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:06:59.042151 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:06:59.042237 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:06:59.042237 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:06:59.042670 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:06:59.042670 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:06:59.042795 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:06:59.042920 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:06:59.043150 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:06:59.043301 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.043397 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:06:59.043627 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.043783 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.043948 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.044108 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.044265 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.044429 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.044600 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.044747 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.044913 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.045076 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.045233 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.045389 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.045553 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.045728 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.045883 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.046024 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.046147 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.046369 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.046495 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.046635 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.046788 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855479-1-iscsi {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.046951 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.047114 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.047276 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855479-1-iscsi {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.047424 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.047597 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.047731 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.047898 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.048029 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.048209 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.048333 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.048528 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.048687 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.048819 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.048941 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.049149 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.049422 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.049724 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.049861 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.049966 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.050155 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.050310 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.050499 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.050627 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.050844 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.050978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.051174 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.051317 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.051480 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.051628 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.051793 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.051922 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.052100 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.052223 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.052416 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.052545 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.052717 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.052842 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.053052 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.053191 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855479-1-iscsi {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.053452 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855479-1-iscsi {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.053575 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.053765 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.053886 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.054078 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.054208 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.054427 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.054563 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.054824 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.054957 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.055135 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.055261 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.055443 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.055567 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.055764 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.055882 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.056073 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.056233 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.056392 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.056541 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.056738 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.056861 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.057003 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.057165 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.057322 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.057448 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.057626 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.057809 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.057934 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.058071 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.058307 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.058432 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.058552 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.058683 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.058862 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.058985 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.059169 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.059284 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.059410 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.059611 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.059749 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.059872 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.060014 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.060137 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.060335 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.060460 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.060657 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.060792 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.060915 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.061027 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.061155 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.061293 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.061478 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.061586 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.061838 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062004 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062128 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062306 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062452 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062584 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062689 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062790 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.062994 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.063107 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.063302 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.063438 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.063608 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.063717 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.063915 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.064027 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.064241 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.064374 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.064523 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.064654 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.064841 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.064973 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.065159 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.065284 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.065467 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.065590 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.065776 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.065898 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.066097 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.066207 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.066448 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.066574 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.066760 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.066876 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.067066 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.067188 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.067411 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.067547 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.067722 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.067833 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.068029 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.068146 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.068347 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.068482 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.069357 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.069493 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.069631 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.069839 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.069965 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.070099 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.070099 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.070372 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.070507 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.070630 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.070756 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.070887 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.071015 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.071142 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.071264 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.071391 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.071613 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.071738 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.071858 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.072068 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.072194 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.072315 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.072444 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.072573 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.072737 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.072862 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.073039 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.073171 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.073336 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.073460 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.073641 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.073765 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.073947 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.074072 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.074571 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.074694 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.074817 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.074938 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075068 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075198 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075320 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075442 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075562 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075682 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075802 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.075930 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.076053 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.076174 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.076319 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.076436 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.076639 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.076779 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.076946 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.077072 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.077250 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.077382 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.077557 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.077766 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.077897 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.078029 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.078158 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.078353 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.078490 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.078622 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.078772 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.078898 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.079085 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.079208 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.079386 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.079516 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.079689 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.079823 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.080013 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.080147 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.080271 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.080399 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.080587 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.080724 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.080888 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.081011 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.081190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.081349 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.081488 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.081743 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.081869 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.081989 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.082196 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.082341 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.082475 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.082598 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.082726 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.082854 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.082983 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.083105 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.083270 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.083401 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.083570 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.083693 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.083869 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.083993 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.084168 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.084341 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.085005 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.085127 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.085328 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.085625 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.085753 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.085874 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.085993 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.086130 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.086300 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.086425 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.086547 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.086680 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.086851 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:06:59.086984 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.087196 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.087332 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.087531 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.087715 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.087911 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.088107 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.088363 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.088568 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.088568 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.088950 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.089142 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.089311 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.089490 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.089671 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.089866 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.090234 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.090487 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.090674 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.090858 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.091002 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.091132 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.091281 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.091444 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.091567 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.091687 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.091898 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.092022 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.092142 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.092378 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.092512 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.092656 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.092785 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.092907 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093036 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093220 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093349 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093476 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093598 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093718 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093838 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.093968 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.094089 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.094216 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.094391 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.094520 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.094641 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.094641 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.094882 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095012 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095141 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095141 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095379 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095379 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095614 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095742 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095873 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.095996 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.096124 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.096245 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.096371 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.096529 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.096666 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.096838 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.096971 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.097166 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.097296 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.097477 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.097601 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.097798 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.097937 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.098111 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.098235 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.098455 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.098580 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.098772 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.098921 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.099081 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.099220 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.099395 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.099580 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.099952 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.100136 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.100346 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.100541 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.100733 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.100920 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.101117 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.101117 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.101481 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.101672 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.101857 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.102173 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.102555 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.102702 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.102840 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.102989 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.103135 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.103295 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.103435 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.103559 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.103681 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.103802 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.103930 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.104061 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.104184 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.104317 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.104441 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.104568 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.104730 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.104925 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.105117 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.105499 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.105676 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.105864 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.105998 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.106129 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.106252 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.106390 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.106525 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.106653 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.106774 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.106904 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107025 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107145 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107264 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107513 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107635 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107754 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107874 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.107993 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.108104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.108231 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.108351 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.108478 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.108612 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.108746 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.108874 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109005 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109126 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109250 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109369 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109502 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109624 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109751 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109879 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.109999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.110118 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.110235 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.110455 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.110579 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.110702 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.110822 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.110942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.111070 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.111204 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.111331 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.111483 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.111619 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.111800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.111926 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.112175 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.112318 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.112448 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.112624 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.112749 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.112879 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.113058 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.113181 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.113385 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.113509 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.113691 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.113823 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.114017 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.114140 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.114340 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.114481 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.114653 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.114787 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.115215 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.115343 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.115709 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.115927 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116056 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116192 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116315 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116435 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116556 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116676 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116840 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.116976 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.117150 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.117283 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.117457 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.117590 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.117766 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.117900 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.118089 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.118214 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.118423 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.118548 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.118730 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.118855 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.119035 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.119169 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.119337 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.119460 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.119641 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.119774 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.119946 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.120084 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.120291 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.120420 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.120599 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.120725 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.120936 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.121066 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.121260 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.121394 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.121575 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.121707 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.121894 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.122016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.122213 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.122442 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.122568 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.122690 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.122839 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.122963 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.123148 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.123283 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.123458 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.123583 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.123768 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.123892 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.124085 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.124216 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.124394 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.124524 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.124710 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.124835 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.125017 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.125142 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.125335 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.125464 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.125640 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.125765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.125965 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.126094 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.126279 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.126384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.126601 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.126700 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.126940 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.127042 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.127261 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.127368 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.127573 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.127670 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.127888 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.127986 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.128194 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.128289 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.128503 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.128599 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.128812 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.128948 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.129117 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.129241 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.129424 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.129563 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.129733 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.129865 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.130048 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.130171 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.130380 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.130511 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.130698 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.130822 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.131006 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.131660 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.131880 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.132048 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.132180 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.132497 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.132639 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.132798 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.132931 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.133112 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.133247 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.133439 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.133565 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.133763 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.133896 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.134072 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.134198 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.134392 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.134499 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.134715 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.134837 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.135026 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.135136 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.135333 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.135442 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.135643 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.135762 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.135945 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.136070 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.136266 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.136390 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.136543 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.136682 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.136854 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.136964 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.137166 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.137277 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.137472 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.137598 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.137772 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.137895 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.138086 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.138195 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.138422 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.138549 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.138728 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.138852 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.139033 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.139158 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.139343 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.139475 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.139657 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.139780 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.139968 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.140091 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.140290 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.140422 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.140599 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.140710 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.140903 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.141025 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.141206 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.141317 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.141522 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.141631 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.141828 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.141962 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.142128 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.142252 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.142454 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.142669 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.142803 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.142934 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.143086 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.143214 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.143395 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.143520 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.143698 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.143832 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.144015 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.144141 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.144323 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.144447 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.144631 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.144767 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.144939 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.145069 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.145246 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.145383 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.145555 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.145680 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.145873 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.145996 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.146182 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.146404 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.146553 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.146675 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.146842 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.147476 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.147689 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.147821 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.148087 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.148224 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.148348 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.148470 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.148591 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.148711 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.148903 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.149029 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.149211 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.149335 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.149517 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.149649 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.149820 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.149946 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.150129 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.150277 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.150484 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.150737 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.151062 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.151187 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.151376 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.151499 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.151700 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.151839 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.152019 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.152149 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.152340 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.152465 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.152697 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.152882 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.153022 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.153127 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.153324 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.153428 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.153631 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.153744 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.153937 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.154148 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.154308 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.154432 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.154554 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.154675 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.154854 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.154997 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.155160 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.155286 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.155461 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.155592 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.155766 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.155902 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.156069 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.156194 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.156385 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.156581 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.156720 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.156849 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.156972 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.157094 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.157256 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.157381 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.157560 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.157686 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.157842 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.157981 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.158158 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.158313 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.158489 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.158616 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.158789 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.158914 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.159114 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.159221 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.159423 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.159521 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.159724 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.159810 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.160026 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.160130 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.160373 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.160684 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.161030 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.161360 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.161700 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.162009 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.162531 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.162795 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.163038 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.163038 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.163345 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.163662 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.163989 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.164315 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.164603 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.164729 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.164915 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.165043 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.165228 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.165353 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.165546 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.165706 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.165841 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.166073 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.166199 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.166427 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.166567 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.166770 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.166919 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.167050 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.167172 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.167362 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.167487 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.167667 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.167810 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.167972 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.168098 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.168284 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.168410 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.168594 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.168721 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.168958 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.169097 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.169219 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.169337 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.169515 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.169640 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.169834 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.169958 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.170137 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.170318 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.170457 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.170581 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.170763 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.170887 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.171074 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.171192 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.171384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.171511 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.171690 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.171817 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.171997 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.172127 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.172305 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.172435 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.172609 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.172730 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.172914 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.173137 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.173263 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.173392 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.173514 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.173635 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.173801 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.173934 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.174109 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.174234 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.174443 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.174568 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.174753 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.174889 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.175054 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.175179 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.175364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.175497 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.175672 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.175798 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.175974 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.176098 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.176280 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.176405 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.176589 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.176724 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.176935 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.177068 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.177199 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.177322 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.177473 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.177607 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.177777 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.177903 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.178109 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.178237 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.178532 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.178665 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.178846 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.178971 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.179153 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.179290 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.179461 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.179594 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.179764 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.179898 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.180113 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.180252 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.180421 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.180547 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.180732 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.180855 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.181045 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.181171 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.181353 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.181486 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.181660 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.181785 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.181966 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.182102 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.182288 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.182417 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.182598 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.182723 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.182903 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.183046 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.183250 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.183376 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.183517 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.183648 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.183823 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.183956 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.184126 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.184249 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.184431 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.184556 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.184758 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.184883 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.185053 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.185186 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.185365 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.185492 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.185695 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.185828 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.186013 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.186137 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.186352 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.186478 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.186658 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.186783 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.186980 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.187105 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.187279 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.187397 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.187585 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.187689 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.187894 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.188008 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.188206 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.188325 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.188507 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.188611 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.188814 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.188917 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.189124 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.189237 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.189433 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.189538 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.189744 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.189846 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.190048 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.190161 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.190381 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.190524 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.190685 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.190789 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.190991 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.191078 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.191302 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.191405 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.191616 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.191712 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.191919 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.192007 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.192227 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.192310 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.192529 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.192637 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.192840 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.192935 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.193142 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.193235 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.193452 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.193584 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.194388 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.194493 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.194774 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.194860 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.195089 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.195243 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.195403 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.195561 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.195716 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.195882 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.196023 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.196201 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.196352 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.196522 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.196661 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.196831 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.196974 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.197252 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.197399 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.197558 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.197696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.197867 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.198012 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.198167 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.198277 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.198496 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.198649 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.198800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.198968 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.199111 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.199282 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.199436 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.199589 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.199742 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.199903 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.200049 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.200217 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.200354 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.200541 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.200678 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.200858 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.200986 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.201165 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.201308 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.201582 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.201775 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.202014 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.202226 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.202466 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.202607 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.202756 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.202901 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.203038 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.203172 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.203305 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.203539 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.203678 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.203826 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.203957 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.204086 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.204213 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.204348 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.204491 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.204637 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.204766 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.204904 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.205033 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.205171 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.205308 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.205469 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.205599 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.205814 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.205957 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.206128 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.206276 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.206467 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.206565 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.206773 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.206909 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.207097 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.207276 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.207422 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.207517 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.207739 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.207831 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.208097 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.208205 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.208447 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.208546 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.208753 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.208838 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.209066 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.209160 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.209931 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.210301 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.210402 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.210699 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.210784 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.211011 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.211095 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.211321 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.211498 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.211625 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.211709 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.211931 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.212066 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.212240 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.212369 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.212567 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.212694 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.212875 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.213011 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.213187 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.213313 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.213498 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.213706 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.213832 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.213964 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.214095 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.214218 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.214415 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.214556 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.214739 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.214875 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.215046 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.215171 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.215369 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.215494 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.215686 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.215812 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.216011 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.216134 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.216332 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.216461 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.216637 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.216769 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.216949 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.217074 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.217333 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.217466 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.217598 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.217721 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.217842 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.217964 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.218141 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.218301 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.218489 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.218616 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.218796 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.218921 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.219119 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.219253 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.219434 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.219559 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.219755 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.219889 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.220068 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.220205 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.220373 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.220496 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.220696 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.220822 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.221004 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.221139 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.221306 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.221432 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.221637 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.221769 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.221893 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.222024 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.222229 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.222372 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.222569 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.222689 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.222966 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.223103 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.223228 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.223350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.223473 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.223595 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.223744 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.223938 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.224065 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.224188 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.224318 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.224442 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.224622 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.224780 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.224974 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.225103 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.225334 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.225486 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.225662 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.225934 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.226060 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.226243 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.226400 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.226575 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.226700 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.226879 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.227002 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.227185 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.227311 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.227529 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.227665 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.227788 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.227908 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.228078 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.228163 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.228381 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.228474 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.228683 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.228780 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.229007 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.229100 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.229311 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.229405 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.229633 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.229719 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.229948 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.230041 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.230291 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.230381 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.230577 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.230662 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.230879 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.230973 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.231221 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.231308 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.231529 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.231612 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.231849 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.231955 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.232186 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.232423 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.232510 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.232755 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.232839 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.233069 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.233168 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.233384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.233469 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.233698 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.233831 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.234020 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.234148 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.234352 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.234487 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.234665 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.234803 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.234973 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.235096 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.235280 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.235405 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.235591 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.235724 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.235907 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.236040 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.236228 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.236466 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.236606 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.236796 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.236930 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.237111 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.237236 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.237424 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.237575 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.237778 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.237905 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.238028 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.238156 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.238339 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.238482 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.238658 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.238784 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.238967 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.239103 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.239277 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.239412 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.239593 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.239720 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.239919 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.240301 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.240522 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.240650 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.240852 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.241147 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.241272 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.241495 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.241725 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.241866 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.242114 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.242283 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.242456 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.242706 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.242835 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.243121 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.243246 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.243428 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.243724 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.243860 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.244043 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.244249 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.244374 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.244655 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.244797 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.244968 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.245217 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.245343 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.245557 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.245690 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.245880 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.246004 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.246189 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.246332 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.246529 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.246654 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.246842 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.247103 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.247229 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.247437 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.247562 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.247783 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.247906 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.248095 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.248205 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.248405 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.248515 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.248719 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.248816 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.249059 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.249254 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.249397 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.249594 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.249787 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.249951 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.250087 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.250213 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.250356 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.250563 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.250714 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.250866 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.251047 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.251231 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.251415 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.251623 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.251805 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.251978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.252121 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.252246 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.252385 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.252518 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.252692 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.252879 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.253068 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.253252 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.253445 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.253624 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.253624 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.253878 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.254069 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.254479 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.254670 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.254876 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255064 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255246 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255246 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255487 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255619 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255743 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255865 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.255986 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.256628 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.256758 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.256878 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.257008 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.257130 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.257272 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.257441 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.257570 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.257702 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.257835 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258074 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258204 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258349 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258485 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258619 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258744 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258865 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.258987 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.259108 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.259238 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.259424 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.259537 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.259733 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.259845 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.260040 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.260263 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.260391 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.260511 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.260633 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.260753 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.260941 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.261080 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.261247 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.261371 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.261553 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.261677 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.261857 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.261998 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.262161 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.262314 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.262490 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.262612 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.262792 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.262916 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.263097 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.263218 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.263399 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.263522 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.263775 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.263905 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.264030 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.264150 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.264292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.264421 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.264638 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.264764 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.264895 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.265017 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.265184 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.265317 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.265488 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.265614 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.265795 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.265921 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.266145 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.266303 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.266483 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.266606 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.266787 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.266913 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.267100 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.267239 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.267394 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.267522 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.267702 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.268057 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.268195 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.268331 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.268460 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.268620 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.268746 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.268964 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.269089 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.269281 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.269414 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.269596 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.269837 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.269962 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.270170 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.270367 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.270515 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.270641 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.270838 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.270963 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.271174 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.271302 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.271449 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.271583 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.271805 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.272583 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.272761 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.272887 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.273010 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.273133 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.273311 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.273452 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.273626 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.273759 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.273939 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.274072 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.274252 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.274415 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.274585 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.274804 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.274937 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.275061 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.275186 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.275320 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.275491 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.275625 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.275808 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.275935 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.276113 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.276238 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.276422 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.276549 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.276732 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.276858 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.277039 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.277173 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.277346 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.277472 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.277657 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.277784 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.277977 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.278131 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.278347 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.278487 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.278619 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.278749 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.278935 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.279061 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.279249 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.279383 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.279562 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.279695 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.279872 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.279997 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.280182 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.280308 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.280492 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.280635 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.280806 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.280940 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.281135 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.281262 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.281451 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.281588 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.281756 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.281868 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.282138 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.282250 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.282477 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.282621 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.282815 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.282942 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.283101 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.283226 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.283420 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.283552 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.283741 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.283872 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.284061 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.284186 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.284372 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.284499 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.284689 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.284833 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.285029 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.285162 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.285293 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.285403 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.285604 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.285731 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.285925 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.286060 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.286238 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.286387 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.286569 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.286699 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.286873 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.287013 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.287180 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.287308 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.287517 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.287649 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.287838 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.287966 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.288206 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.288344 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.288542 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.288670 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.288801 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.288934 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.289101 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.289227 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.289405 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.289531 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.289708 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.289843 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.290012 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.290138 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.290338 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.290478 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.290644 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.290779 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.290952 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.291081 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.291257 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.291392 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.291605 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.291738 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.291861 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.291990 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.292148 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.292282 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.292447 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.292578 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.292750 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.292957 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.293082 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.293218 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.293354 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.293477 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.293629 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.293741 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.293931 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.294051 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.294232 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.294367 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.294586 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.294697 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.294916 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.295044 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.295267 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.295380 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.295539 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.295673 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.295849 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.295983 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.296168 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.296295 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.296477 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.296603 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.296788 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.296899 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.297099 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.297211 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.297411 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.297522 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.297718 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.298027 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.298137 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.298367 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.298585 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.298768 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.298882 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.298987 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.299096 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.299273 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.299393 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.299583 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.299694 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.299897 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.300008 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.300210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.300400 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.300506 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.300610 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.300827 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.300937 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.301137 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.301247 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.301449 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.301568 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.301759 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.301870 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.302070 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.302199 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.302402 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.302540 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.302722 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.302849 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.303565 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.303697 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.303935 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.304060 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.304254 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.304415 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.304571 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.304731 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.304903 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.305029 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.305288 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.305432 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.305564 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.305688 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.305853 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.305971 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.306183 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.306339 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.306553 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.306678 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.306871 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.307003 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.307208 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.307331 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.307851 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308003 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308118 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308240 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308371 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308495 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308495 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308732 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.308940 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:06:59.309066 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.309203 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.309434 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.309749 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.310062 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.310400 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:06:59.310646 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:06:59.463698 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO dbcounter [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Registered counter for database nova_api Sep 01 08:06:59.465369 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO dbcounter [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Registered counter for database nova_api Sep 01 08:06:59.484960 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_db.sqlalchemy.engines [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.487071 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_db.sqlalchemy.engines [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.492960 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writer thread running {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:06:59.494456 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writer thread running {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:06:59.551182 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.context [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68db8b0b-4cf2-486d-b60d-ca583ee6448a(cell1) {{(pid=105720) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 08:06:59.551499 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.context [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68db8b0b-4cf2-486d-b60d-ca583ee6448a(cell1) {{(pid=105719) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 08:06:59.555026 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_concurrency.lockutils [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:06:59.555344 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:06:59.555498 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_concurrency.lockutils [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:06:59.555809 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:06:59.557050 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_concurrency.lockutils [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:06:59.557397 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:06:59.557764 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_concurrency.lockutils [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:06:59.558112 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:06:59.558199 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_concurrency.lockutils [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:06:59.558575 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:06:59.560183 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_concurrency.lockutils [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:06:59.560531 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:06:59.562170 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO dbcounter [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Registered counter for database nova_cell0 Sep 01 08:06:59.562549 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO dbcounter [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Registered counter for database nova_cell0 Sep 01 08:06:59.566346 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO dbcounter [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Registered counter for database nova_cell1 Sep 01 08:06:59.566509 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO dbcounter [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Registered counter for database nova_cell1 Sep 01 08:06:59.573451 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_db.sqlalchemy.engines [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.575206 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_db.sqlalchemy.engines [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.578636 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_db.sqlalchemy.engines [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.580389 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_db.sqlalchemy.engines [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.581132 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writer thread running {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:06:59.582922 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writer thread running {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:06:59.586911 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writer thread running {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:06:59.589174 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writer thread running {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:06:59.728228 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO dbcounter [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Registered counter for database nova_cell0 Sep 01 08:06:59.733605 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO dbcounter [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Registered counter for database nova_cell0 Sep 01 08:06:59.737120 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG oslo_db.sqlalchemy.engines [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.741855 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_db.sqlalchemy.engines [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:06:59.743766 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writer thread running {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:06:59.746833 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writer thread running {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:07:00.083236 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: WARNING keystonemiddleware.auth_token [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:07:00.084700 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: WARNING keystonemiddleware.auth_token [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:07:00.091134 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: WARNING keystonemiddleware.auth_token [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:07:00.091970 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: WARNING keystonemiddleware.auth_token [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:07:00.436937 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: WARNING keystonemiddleware.auth_token [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:07:00.443017 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: WARNING keystonemiddleware.auth_token [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:07:00.444831 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: WARNING keystonemiddleware.auth_token [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:07:00.448880 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3cbe779c0 pid: 105719 (default app) Sep 01 08:07:00.450876 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: WARNING keystonemiddleware.auth_token [None req-84dc7b82-5ce8-4a5e-87c3-8f95bcd966b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:07:00.451051 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:07:00.452272 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001863 Sep 01 08:07:00.452686 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Thu Sep 1 08:07:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:07:00.456289 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3cbe779c0 pid: 105720 (default app) Sep 01 08:08:25.405158 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:25.406092 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 01 08:08:25.406535 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:08:25.419840 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writing DB stats nova_api:SELECT=3 {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:25.420906 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writing DB stats nova_cell1:SELECT=3 {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:25.421772 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writing DB stats nova_cell0:SELECT=3 {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:25.423105 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:26.695772 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-316c2e0c-df3c-430b-b01e-0513a397b473 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:26.730633 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-316c2e0c-df3c-430b-b01e-0513a397b473 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.316024 Sep 01 08:08:26.731380 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Sep 1 08:08:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:29.608259 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:29.609859 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-391da8af-f54c-4625-ab21-5f13e0f99d22 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002347 Sep 01 08:08:29.610613 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:08:30.298343 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-da36ba93-112b-43b9-80d3-3850bdb13ca4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "swap": 0, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:30.352999 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-da36ba93-112b-43b9-80d3-3850bdb13ca4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.731532 Sep 01 08:08:30.353903 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:08:30.370444 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_api:SELECT=3 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:30.371933 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_cell1:SELECT=3 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:30.372740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_cell0:SELECT=3 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:30.373448 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:30.587738 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-bf0ac8a3-b11f-4f60-b11f-9a3635c8ed20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:30.658370 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-bf0ac8a3-b11f-4f60-b11f-9a3635c8ed20 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294186 Sep 01 08:08:30.659781 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Sep 1 08:08:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:08:33.696459 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-da36ba93-112b-43b9-80d3-3850bdb13ca4 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:33.697515 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-da36ba93-112b-43b9-80d3-3850bdb13ca4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 01 08:08:33.697939 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:08:34.647945 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-5c8623d9-112d-4f19-9b4b-f8fccd1d93a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:34.692605 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-5c8623d9-112d-4f19-9b4b-f8fccd1d93a0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.987491 Sep 01 08:08:34.693387 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 08:08:34.708406 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-6472817b-2757-4794-94a9-7a59c47a44e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:34.752551 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-6472817b-2757-4794-94a9-7a59c47a44e4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049233 Sep 01 08:08:34.753641 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Sep 1 08:08:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:37.400965 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-5c8623d9-112d-4f19-9b4b-f8fccd1d93a0 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:37.401892 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-5c8623d9-112d-4f19-9b4b-f8fccd1d93a0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 01 08:08:37.402328 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:08:37.868913 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-78e8c08b-5a98-4e97-ac85-842d61772732 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "ram": 1024, "disk": 10, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:37.888805 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-78e8c08b-5a98-4e97-ac85-842d61772732 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480335 Sep 01 08:08:37.889363 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:08:37.901756 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-de508454-8bc6-445b-abbc-5239a9f31ce9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:37.932779 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-de508454-8bc6-445b-abbc-5239a9f31ce9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034278 Sep 01 08:08:37.942312 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Sep 1 08:08:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:40.472095 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-78e8c08b-5a98-4e97-ac85-842d61772732 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:40.473764 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-78e8c08b-5a98-4e97-ac85-842d61772732 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003037 Sep 01 08:08:40.476703 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:08:41.073830 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-0f317cce-eda3-4839-ac2e-d6b57a8367ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "disk": 10, "vcpus": 2}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:41.099080 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-0f317cce-eda3-4839-ac2e-d6b57a8367ed admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.615356 Sep 01 08:08:41.099958 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:08:41.117435 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-1e08df6c-3743-4bdc-a1f5-4fe1e06980fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:41.164964 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-1e08df6c-3743-4bdc-a1f5-4fe1e06980fa admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055914 Sep 01 08:08:41.172378 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Sep 1 08:08:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:44.040538 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-0f317cce-eda3-4839-ac2e-d6b57a8367ed admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:44.041537 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-0f317cce-eda3-4839-ac2e-d6b57a8367ed admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 01 08:08:44.041932 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:08:44.584227 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-8cd1813a-b003-4b6e-a6f3-189161993991 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:44.609868 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-8cd1813a-b003-4b6e-a6f3-189161993991 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.560921 Sep 01 08:08:44.614301 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:08:44.630332 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-3c2bc047-ef0f-4281-b220-a833343f461b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:44.663225 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-3c2bc047-ef0f-4281-b220-a833343f461b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042084 Sep 01 08:08:44.664585 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Sep 1 08:08:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:47.224766 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-8cd1813a-b003-4b6e-a6f3-189161993991 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:47.225827 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-8cd1813a-b003-4b6e-a6f3-189161993991 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 01 08:08:47.226250 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:08:47.832099 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-320c3f71-1108-4c24-a4f4-a1b8c8cd24fb admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:47.880029 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-320c3f71-1108-4c24-a4f4-a1b8c8cd24fb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.646431 Sep 01 08:08:47.881137 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Sep 1 08:08:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:08:50.606920 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-8cd1813a-b003-4b6e-a6f3-189161993991 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:50.608657 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-8cd1813a-b003-4b6e-a6f3-189161993991 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Sep 01 08:08:50.609344 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:08:51.198171 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-5913666a-27c4-4ec0-a50e-dc6cc49ca69f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:51.218876 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-5913666a-27c4-4ec0-a50e-dc6cc49ca69f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.598497 Sep 01 08:08:51.219429 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:08:51.232039 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-71e18db8-926b-4b82-9fcf-103a9ef3a520 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:51.259842 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-71e18db8-926b-4b82-9fcf-103a9ef3a520 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031448 Sep 01 08:08:51.260434 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Sep 1 08:08:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:53.852991 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-5913666a-27c4-4ec0-a50e-dc6cc49ca69f admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:53.855738 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-5913666a-27c4-4ec0-a50e-dc6cc49ca69f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003394 Sep 01 08:08:53.856418 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:53 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:08:54.300326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-8011e9d5-a9a7-4cc6-9128-fc230401ac13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "disk": 20, "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:54.328977 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-8011e9d5-a9a7-4cc6-9128-fc230401ac13 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460832 Sep 01 08:08:54.329751 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:08:54.348445 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-7d1fa333-7115-44d7-bee6-ad234c26f218 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:54.386503 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-7d1fa333-7115-44d7-bee6-ad234c26f218 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042720 Sep 01 08:08:54.387149 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Sep 1 08:08:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:56.898107 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-8011e9d5-a9a7-4cc6-9128-fc230401ac13 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:56.899059 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-8011e9d5-a9a7-4cc6-9128-fc230401ac13 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 01 08:08:56.899461 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:08:57.410001 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-b210e370-db6a-4a23-b7ed-93c2e383cf7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:57.479395 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-b210e370-db6a-4a23-b7ed-93c2e383cf7a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.572353 Sep 01 08:08:57.480957 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 08:08:57.494003 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-e00407cd-a14d-4240-ae92-6cd0b5474464 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:08:57.505243 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:57.525462 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-e00407cd-a14d-4240-ae92-6cd0b5474464 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035074 Sep 01 08:08:57.526070 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Sep 1 08:08:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:08:59.968852 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-b210e370-db6a-4a23-b7ed-93c2e383cf7a admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:08:59.969948 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-b210e370-db6a-4a23-b7ed-93c2e383cf7a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 01 08:08:59.974444 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:00.464348 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-3d04127b-3539-466d-9f07-3f159a5deb1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:00.489321 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-3d04127b-3539-466d-9f07-3f159a5deb1e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.511822 Sep 01 08:09:00.489932 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:08:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:09:00.502183 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-b096dab5-36c6-483d-a942-d4c31e0c2540 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:00.529942 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-b096dab5-36c6-483d-a942-d4c31e0c2540 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031478 Sep 01 08:09:00.530752 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Sep 1 08:09:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:09:03.054602 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-3d04127b-3539-466d-9f07-3f159a5deb1e admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:03.055607 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-3d04127b-3539-466d-9f07-3f159a5deb1e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 01 08:09:03.056009 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:03.516431 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-78c43484-9c81-4b69-9a1e-291dd7ef208d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "id": "5", "name": "m1.xlarge", "disk": 160, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:03.525508 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:03.539802 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-78c43484-9c81-4b69-9a1e-291dd7ef208d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477503 Sep 01 08:09:03.540395 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Sep 1 08:09:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:09:03.552826 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-07c2d75c-6d9b-439b-b2ca-7c58433f6fc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:03.586538 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-07c2d75c-6d9b-439b-b2ca-7c58433f6fc8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037520 Sep 01 08:09:03.587031 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Sep 1 08:09:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:09:21.747862 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-78c43484-9c81-4b69-9a1e-291dd7ef208d admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:21.748914 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-78c43484-9c81-4b69-9a1e-291dd7ef208d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 01 08:09:21.749320 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:21.760035 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:22.149032 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-2bc77265-aa03-494f-a209-49d198a7a9a6 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:22.169071 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-2bc77265-aa03-494f-a209-49d198a7a9a6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413443 Sep 01 08:09:22.169537 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Sep 1 08:09:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:09:23.259402 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-78c43484-9c81-4b69-9a1e-291dd7ef208d admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:23.260414 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-78c43484-9c81-4b69-9a1e-291dd7ef208d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 01 08:09:23.260816 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:23.814780 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-07628c9d-50e2-4c23-988e-525ade20ff5c admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:23.820431 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.wsgi [None req-07628c9d-50e2-4c23-988e-525ade20ff5c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-07628c9d-50e2-4c23-988e-525ade20ff5c admin admin] Request method failure captured: Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Accept: application/json Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Accept-Encoding: gzip, deflate Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Connection: keep-alive Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Content-Length: 0 Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Host: 10.222.0.43 Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Openstack-Api-Version: compute 2.90 Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Openstack-System-Scope: None Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: User-Agent: python-novaclient Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Auth-Token: gAAAAABjEGizm20UDyMxRN1ziVI3Sh-Jrm49KR7a3CGrQnF5yg9JRvIl3Z3OxqSxiSTu1trl-0YVtGOySy3J7e4bViPj6hKa6rTBOO8f1vJw5az_t1TKWiNIxfKf0gNt6wRsFNxoJtcd3-n9jRPM-FcfYwLlNUjLVWz2NGvQMoyluZrVKr2OlhI Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Domain-Id: None Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Domain-Name: None Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Identity-Status: Confirmed Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Is-Admin-Project: True Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Domain-Id: default Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Domain-Name: Default Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Name: admin Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Role: admin,reader,member Sep 01 08:09:23.823696 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Roles: admin,reader,member Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_41333422ff5e4255bb6c2174f444b692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant: admin Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant-Name: admin Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User: admin Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Domain-Id: default Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Domain-Name: Default Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Id: d2d8becce6b1469fa561088c062a1608 Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Name: admin Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: method: > Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: exception: Flavor 42 could not be found. Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: action_args: {'id': '42'} Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:09:23.825326 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:23.826364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.827800 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-07628c9d-50e2-4c23-988e-525ade20ff5c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:09:23.829735 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-07628c9d-50e2-4c23-988e-525ade20ff5c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.425576 Sep 01 08:09:23.829735 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Sep 1 08:09:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:23.835571 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-aa8fea73-36fe-4881-abfa-e506cfbe915b admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:23.859738 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-aa8fea73-36fe-4881-abfa-e506cfbe915b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027659 Sep 01 08:09:23.860299 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Sep 1 08:09:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:09:23.870656 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-7f5bc55f-f436-4d9a-9378-2a5c4fe0a811 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:23.894382 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-7f5bc55f-f436-4d9a-9378-2a5c4fe0a811 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027236 Sep 01 08:09:23.894942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Sep 1 08:09:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:09:23.905007 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-2f408ccc-1c5d-4a4c-8d12-22959ba84c06 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:23.912108 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.wsgi [None req-2f408ccc-1c5d-4a4c-8d12-22959ba84c06 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-2f408ccc-1c5d-4a4c-8d12-22959ba84c06 admin admin] Request method failure captured: Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Accept: application/json Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Accept-Encoding: gzip, deflate Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Connection: keep-alive Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Content-Length: 0 Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Host: 10.222.0.43 Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Openstack-Api-Version: compute 2.90 Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Openstack-System-Scope: None Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: User-Agent: python-novaclient Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Auth-Token: gAAAAABjEGizm20UDyMxRN1ziVI3Sh-Jrm49KR7a3CGrQnF5yg9JRvIl3Z3OxqSxiSTu1trl-0YVtGOySy3J7e4bViPj6hKa6rTBOO8f1vJw5az_t1TKWiNIxfKf0gNt6wRsFNxoJtcd3-n9jRPM-FcfYwLlNUjLVWz2NGvQMoyluZrVKr2OlhI Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Domain-Id: None Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Domain-Name: None Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Identity-Status: Confirmed Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Is-Admin-Project: True Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Domain-Id: default Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Domain-Name: Default Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Name: admin Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Role: admin,reader,member Sep 01 08:09:23.915364 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Roles: admin,reader,member Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_41333422ff5e4255bb6c2174f444b692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant: admin Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant-Name: admin Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User: admin Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Domain-Id: default Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Domain-Name: Default Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Id: d2d8becce6b1469fa561088c062a1608 Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Name: admin Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: method: > Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: exception: Flavor 42 could not be found. Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: action_args: {'id': '42'} Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:09:23.916871 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:23.917765 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:23.918978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-2f408ccc-1c5d-4a4c-8d12-22959ba84c06 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:09:23.920275 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-2f408ccc-1c5d-4a4c-8d12-22959ba84c06 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015943 Sep 01 08:09:23.920275 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Sep 1 08:09:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:24.916935 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-7f5bc55f-f436-4d9a-9378-2a5c4fe0a811 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:24.917940 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-7f5bc55f-f436-4d9a-9378-2a5c4fe0a811 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 01 08:09:24.918354 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:25.449571 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-9a696ed6-49b0-4a87-8647-581646c199cf admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:25.456474 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.wsgi [None req-9a696ed6-49b0-4a87-8647-581646c199cf admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-9a696ed6-49b0-4a87-8647-581646c199cf admin admin] Request method failure captured: Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Accept: application/json Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Accept-Encoding: gzip, deflate Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Connection: keep-alive Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Content-Length: 0 Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Host: 10.222.0.43 Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Openstack-Api-Version: compute 2.90 Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Openstack-System-Scope: None Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: User-Agent: python-novaclient Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Auth-Token: gAAAAABjEGi0kPcDXTKSwN4y6RjnYMIuq0jv1aGajeA7x9-pjZKd6lBtzp2U4nY5cPPvU93WGIRfWwM-kGUr-oJUWP-z8mtDb8kNbvRuDOUgVHDu8bue5svShQsnWqYxOjd7uqqmXQQNtojnTZkk3SUTDXirNyPz3C-tfCKsAAVnHJ5D3he4TTw Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Domain-Id: None Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Domain-Name: None Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Identity-Status: Confirmed Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Is-Admin-Project: True Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Domain-Id: default Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Domain-Name: Default Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Name: admin Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Role: admin,reader,member Sep 01 08:09:25.457999 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Roles: admin,reader,member Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_41333422ff5e4255bb6c2174f444b692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant: admin Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant-Name: admin Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User: admin Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Domain-Id: default Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Domain-Name: Default Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Id: d2d8becce6b1469fa561088c062a1608 Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Name: admin Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: method: > Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: exception: Flavor 84 could not be found. Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: action_args: {'id': '84'} Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:09:25.459292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:25.461156 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.462692 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-9a696ed6-49b0-4a87-8647-581646c199cf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:09:25.463941 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-9a696ed6-49b0-4a87-8647-581646c199cf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404465 Sep 01 08:09:25.463941 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Sep 1 08:09:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:25.469183 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-80e8ce4f-7e50-496c-85da-95a362aaa292 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:25.484981 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-80e8ce4f-7e50-496c-85da-95a362aaa292 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019160 Sep 01 08:09:25.485772 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Sep 1 08:09:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:09:25.495350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-c08a7287-9c3f-42dc-b118-9bc6f87b3629 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:25.511173 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-c08a7287-9c3f-42dc-b118-9bc6f87b3629 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019304 Sep 01 08:09:25.511724 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Sep 1 08:09:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:09:25.522025 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-cb5bb8c6-72a4-413d-bc19-063ac1fe904c admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:25.527452 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.wsgi [None req-cb5bb8c6-72a4-413d-bc19-063ac1fe904c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-cb5bb8c6-72a4-413d-bc19-063ac1fe904c admin admin] Request method failure captured: Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Accept: application/json Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Accept-Encoding: gzip, deflate Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Connection: keep-alive Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Content-Length: 0 Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Host: 10.222.0.43 Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Openstack-Api-Version: compute 2.90 Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Openstack-System-Scope: None Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: User-Agent: python-novaclient Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Auth-Token: gAAAAABjEGi0kPcDXTKSwN4y6RjnYMIuq0jv1aGajeA7x9-pjZKd6lBtzp2U4nY5cPPvU93WGIRfWwM-kGUr-oJUWP-z8mtDb8kNbvRuDOUgVHDu8bue5svShQsnWqYxOjd7uqqmXQQNtojnTZkk3SUTDXirNyPz3C-tfCKsAAVnHJ5D3he4TTw Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Domain-Id: None Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Domain-Name: None Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Identity-Status: Confirmed Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Is-Admin-Project: True Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Domain-Id: default Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Domain-Name: Default Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Name: admin Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Role: admin,reader,member Sep 01 08:09:25.528942 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Roles: admin,reader,member Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_41333422ff5e4255bb6c2174f444b692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant: admin Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant-Name: admin Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User: admin Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Domain-Id: default Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Domain-Name: Default Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Id: d2d8becce6b1469fa561088c062a1608 Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Name: admin Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: method: > Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: exception: Flavor 84 could not be found. Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: action_args: {'id': '84'} Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:09:25.530408 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:25.531267 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:25.532407 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-cb5bb8c6-72a4-413d-bc19-063ac1fe904c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:09:25.533609 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-cb5bb8c6-72a4-413d-bc19-063ac1fe904c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011874 Sep 01 08:09:25.533609 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Sep 1 08:09:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:26.561254 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-c08a7287-9c3f-42dc-b118-9bc6f87b3629 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:26.562292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-c08a7287-9c3f-42dc-b118-9bc6f87b3629 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 01 08:09:26.562674 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:27.149719 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-b4909acd-64ad-4c2a-bf66-20438ba3d506 admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:27.155653 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.wsgi [None req-b4909acd-64ad-4c2a-bf66-20438ba3d506 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-b4909acd-64ad-4c2a-bf66-20438ba3d506 admin admin] Request method failure captured: Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Accept: application/json Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Accept-Encoding: gzip, deflate Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Connection: keep-alive Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Content-Length: 0 Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Host: 10.222.0.43 Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Openstack-Api-Version: compute 2.90 Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Openstack-System-Scope: None Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: User-Agent: python-novaclient Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Auth-Token: gAAAAABjEGi27DHjVGS9lBBZNbAEP9yhwOWJQmKLH3_kC5jjqBczmXwzNO1qqFY2LHiAhIvMaoPlYaiEc5RVimMkutU2tpBRmgBX9MLsEqQgz9XhQIu2zfyHqAZJtLD3uJ6G7zp_x5_k-hTV6ewCi1jJgV21q4I1yWf5sTZs8C7vb2NeA8F0jq8 Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Domain-Id: None Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Domain-Name: None Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Identity-Status: Confirmed Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Is-Admin-Project: True Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Domain-Id: default Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Domain-Name: Default Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Project-Name: admin Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Role: admin,reader,member Sep 01 08:09:27.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Roles: admin,reader,member Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_41333422ff5e4255bb6c2174f444b692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant: admin Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-Tenant-Name: admin Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User: admin Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Domain-Id: default Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Domain-Name: Default Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Id: d2d8becce6b1469fa561088c062a1608 Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: X-User-Name: admin Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: method: > Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: exception: Flavor 451 could not be found. Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: action_args: {'id': '451'} Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:09:27.159016 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:27.160104 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.161384 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-b4909acd-64ad-4c2a-bf66-20438ba3d506 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:09:27.162658 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-b4909acd-64ad-4c2a-bf66-20438ba3d506 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.456187 Sep 01 08:09:27.162658 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Sep 1 08:09:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:27.168330 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-9dcbddc1-aae1-43b8-a234-ec4f3b70c852 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:27.184419 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-9dcbddc1-aae1-43b8-a234-ec4f3b70c852 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019626 Sep 01 08:09:27.184994 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Sep 1 08:09:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:09:27.195366 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:27.211811 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019989 Sep 01 08:09:27.212397 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Sep 1 08:09:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:09:27.222292 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-3638562b-b200-4e97-a7cd-67c80a3e3de3 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:27.227786 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.wsgi [None req-3638562b-b200-4e97-a7cd-67c80a3e3de3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-3638562b-b200-4e97-a7cd-67c80a3e3de3 admin admin] Request method failure captured: Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Accept: application/json Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Accept-Encoding: gzip, deflate Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Connection: keep-alive Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Content-Length: 0 Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Host: 10.222.0.43 Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Openstack-Api-Version: compute 2.90 Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Openstack-System-Scope: None Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: User-Agent: python-novaclient Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Auth-Token: gAAAAABjEGi27DHjVGS9lBBZNbAEP9yhwOWJQmKLH3_kC5jjqBczmXwzNO1qqFY2LHiAhIvMaoPlYaiEc5RVimMkutU2tpBRmgBX9MLsEqQgz9XhQIu2zfyHqAZJtLD3uJ6G7zp_x5_k-hTV6ewCi1jJgV21q4I1yWf5sTZs8C7vb2NeA8F0jq8 Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Domain-Id: None Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Domain-Name: None Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Identity-Status: Confirmed Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Is-Admin-Project: True Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Domain-Id: default Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Domain-Name: Default Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Project-Name: admin Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Role: admin,reader,member Sep 01 08:09:27.229278 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Roles: admin,reader,member Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_41333422ff5e4255bb6c2174f444b692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/41333422ff5e4255bb6c2174f444b692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant: admin Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant-Id: 41333422ff5e4255bb6c2174f444b692 Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-Tenant-Name: admin Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User: admin Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Domain-Id: default Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Domain-Name: Default Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Id: d2d8becce6b1469fa561088c062a1608 Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: X-User-Name: admin Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: method: > Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: exception: Flavor 451 could not be found. Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: action_args: {'id': '451'} Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:09:27.231740 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:27.233350 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: ERROR nova.api.openstack.wsgi Sep 01 08:09:27.236190 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-3638562b-b200-4e97-a7cd-67c80a3e3de3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:09:27.238239 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-3638562b-b200-4e97-a7cd-67c80a3e3de3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012311 Sep 01 08:09:27.238239 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Sep 1 08:09:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:28.241364 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:28.242393 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 01 08:09:28.242791 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:28.789197 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-f4cb0da8-32d4-4627-8fc8-b6d5c2274f91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:28.809338 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-f4cb0da8-32d4-4627-8fc8-b6d5c2274f91 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.427120 Sep 01 08:09:28.809893 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Sep 1 08:09:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:09:29.818943 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:29.819944 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 01 08:09:29.820343 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:30.363455 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-76fd0fdf-d8dd-48de-b039-c63bc3007769 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:30.382037 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-76fd0fdf-d8dd-48de-b039-c63bc3007769 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.425700 Sep 01 08:09:30.382545 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Sep 1 08:09:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:09:31.364321 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:31.365358 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 01 08:09:31.365755 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:31.908345 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-daf972ab-bec5-445c-ae5d-1786008e50e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:31.927561 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-daf972ab-bec5-445c-ae5d-1786008e50e1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.424512 Sep 01 08:09:31.928107 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Sep 1 08:09:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:09:32.915675 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:32.916679 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 01 08:09:32.917062 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:09:33.448239 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-e298f569-9ad3-42ff-bf66-89df775826c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:09:33.466989 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-e298f569-9ad3-42ff-bf66-89df775826c9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414034 Sep 01 08:09:33.467556 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Sep 1 08:09:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:09:34.450531 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:34.451547 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 01 08:09:34.451978 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:09:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:09:35.001007 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-1249df6a-d904-4a85-8805-dea8b1b8a15e admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:09:35.021808 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-1249df6a-d904-4a85-8805-dea8b1b8a15e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.432090 Sep 01 08:09:35.022362 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Thu Sep 1 08:09:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:10:29.453933 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:10:29.455647 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-0a8ea6a5-e06d-4bc3-b487-73ec3cebb2ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Sep 01 08:10:29.456338 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Thu Sep 1 08:10:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:10:29.468166 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:29.943492 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-ff7f52b9-d1ee-46b1-9109-e4eb2f1dbff8 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:10:29.964897 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-ff7f52b9-d1ee-46b1-9109-e4eb2f1dbff8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.501604 Sep 01 08:10:29.965471 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Sep 1 08:10:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:10:29.988962 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG dbcounter [-] [105720] Writing DB stats nova_api:SELECT=14 {{(pid=105720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:29.993207 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-e9f27491-f65b-48c6-a3d4-81772944060a admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:10:30.001785 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-e9f27491-f65b-48c6-a3d4-81772944060a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014207 Sep 01 08:10:30.002370 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Thu Sep 1 08:10:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:10:30.014273 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-0668e472-3575-453b-813e-0c8bdd45daed admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:10:30.022652 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-0668e472-3575-453b-813e-0c8bdd45daed admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011739 Sep 01 08:10:30.023147 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Thu Sep 1 08:10:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:10:30.036708 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:10:30.045514 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012450 Sep 01 08:10:30.046083 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Thu Sep 1 08:10:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:10:30.058637 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-86f957e4-ab14-45a7-9c2c-01cfe776dd8b admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:10:30.067608 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-86f957e4-ab14-45a7-9c2c-01cfe776dd8b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012400 Sep 01 08:10:30.068185 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Thu Sep 1 08:10:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:13:47.117998 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:13:47.119072 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 01 08:13:47.120021 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:13:47.277011 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_api:SELECT=6 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:47.442663 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:13:47.446437 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:13:47.446941 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:13:47.447446 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:13:47.448652 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:13:47.449134 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:13:47.449605 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:13:47.485106 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-bc1ba4a7-4640-4e09-b432-b4e31ba6e033 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210083 Sep 01 08:13:47.485682 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Sep 1 08:13:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:13:48.331628 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:13:48.332634 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 01 08:13:48.333058 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:13:48.528804 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:13:48.532194 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:13:48.532667 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:13:48.533092 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:13:48.533832 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:13:48.534379 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:13:48.534703 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:13:48.554401 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-b28d2901-c1a0-4afb-9fd6-e41e557a392e admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078263 Sep 01 08:13:48.554890 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Sep 1 08:13:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 08:13:59.793068 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:13:59.794068 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 01 08:13:59.794506 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:13:59.938782 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_cell0:SELECT=4 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:59.939501 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_cell1:SELECT=4 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:59.940113 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG dbcounter [-] [105719] Writing DB stats nova_api:SELECT=8 {{(pid=105719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:59.989729 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:13:59.993353 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:13:59.993863 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:13:59.994508 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:13:59.995226 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:13:59.995672 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:13:59.996086 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:14:00.021613 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-de5db9ed-36f1-4cf2-8414-81e193ba62b3 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087183 Sep 01 08:14:00.022313 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Sep 1 08:13:59 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:14:00.863076 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: DEBUG nova.api.openstack.wsgi [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] Calling method '>' {{(pid=105720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:14:00.864081 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: INFO nova.api.openstack.requestlog [None req-dea00237-0ac3-4b2f-b681-40fc753ae2cd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 01 08:14:00.864537 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: [pid: 105720|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Sep 1 08:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:14:01.064492 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG nova.api.openstack.wsgi [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] Calling method '>' {{(pid=105719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:14:01.067942 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:14:01.068392 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:14:01.068825 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:14:01.069534 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:14:01.069978 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:14:01.070425 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: DEBUG oslo_concurrency.lockutils [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:14:01.093200 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: INFO nova.api.openstack.requestlog [None req-a3820b92-638e-4d92-b5d4-49d455605d9a admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081249 Sep 01 08:14:01.093748 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: [pid: 105719|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Sep 1 08:14:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:14:58.636618 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: Thu Sep 1 08:14:58 2022 - graceful shutdown triggered... Sep 01 08:14:58.637339 dv-cinder-855479-1-iscsi devstack@n-api.service[105719]: Gracefully killing worker 1 (pid: 105719)... Sep 01 08:14:58.638861 dv-cinder-855479-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 08:14:58.639460 dv-cinder-855479-1-iscsi devstack@n-api.service[105720]: Gracefully killing worker 2 (pid: 105720)... Sep 01 08:14:59.637270 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: worker 1 buried after 1 seconds Sep 01 08:14:59.637827 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: worker 2 buried after 1 seconds Sep 01 08:14:59.637827 dv-cinder-855479-1-iscsi devstack@n-api.service[105718]: goodbye to uWSGI. Sep 01 08:14:59.639046 dv-cinder-855479-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 08:14:59.639651 dv-cinder-855479-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 08:14:59.642609 dv-cinder-855479-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 08:14:59.653944 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 08:14:59 2022] *** Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: nodename: dv-cinder-855479-1-iscsi Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: machine: x86_64 Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: clock source: unix Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: pcre jit disabled Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: detected number of CPU cores: 4 Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: current working directory: / Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: detected binary path: /usr/bin/uwsgi-core Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: your processes number limit is 47680 Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: your memory page size is 4096 bytes Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: detected max file descriptor number: 2048 Sep 01 08:14:59.656048 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: lock engine: pthread robust mutexes Sep 01 08:14:59.656942 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: thunder lock: enabled Sep 01 08:14:59.656942 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 08:14:59.656942 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 08:14:59.696559 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: Python main interpreter initialized at 0x562d52ed19c0 Sep 01 08:14:59.696559 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: python threads support enabled Sep 01 08:14:59.696559 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: your server socket listen backlog is limited to 100 connections Sep 01 08:14:59.696559 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: your mercy for graceful operations on workers is 90 seconds Sep 01 08:14:59.697103 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 08:14:59.697103 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: *** Operational MODE: preforking *** Sep 01 08:14:59.697286 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: *** uWSGI is running in multiple interpreter mode *** Sep 01 08:14:59.697286 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: spawned uWSGI master process (pid: 120741) Sep 01 08:14:59.697510 dv-cinder-855479-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 08:14:59.698904 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: spawned uWSGI worker 1 (pid: 120752, cores: 1) Sep 01 08:14:59.698904 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: spawned uWSGI worker 2 (pid: 120753, cores: 1) Sep 01 08:14:59.698904 dv-cinder-855479-1-iscsi devstack@n-api.service[120741]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 08:15:00.379179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 08:15:00.396189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 08:15:01.536729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:15:01.536729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: from cryptography.utils import int_from_bytes Sep 01 08:15:01.537369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:15:01.537369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: from cryptography.utils import int_from_bytes Sep 01 08:15:01.573044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:15:01.573044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: from cryptography.utils import int_from_bytes Sep 01 08:15:01.573644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:15:01.573644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: from cryptography.utils import int_from_bytes Sep 01 08:15:03.987725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:15:03.988266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:15:03.988542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:15:03.988897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:15:03.989159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:15:03.989558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.989891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.990215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.990563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.990915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.991216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.992088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.992413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.992746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.993014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.993334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.993680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855479-1-iscsi {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.994170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.994513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.994834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.995163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.995478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.995805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.996127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.996637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.997985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.997985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.997985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.998433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.998706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.999038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.999366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:03.999697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.000016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.000331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.000741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855479-1-iscsi {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.001054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.001381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.001699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.002123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.002476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.002789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.003114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.003437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.003756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.004085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.004411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.004737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.005058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.005370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.005709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.006000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.006353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.006666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.007688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.008093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.008423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.008760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.009089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.009424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.009682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.009943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.010304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.010621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.010938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.011254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.011568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.011881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.012193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.012504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.012816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.013210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.013449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.013772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.014103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.014457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.014786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.015201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.015461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.015776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.016125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.016448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.016766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.017085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.017410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.017723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.018040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.018375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.018694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.019039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.019352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.019608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.019913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.020224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.020547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.020858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.021170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.021482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.021785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.022094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.022431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.022935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.023252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.023567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.023999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.024182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.024507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.024809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.025143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.025460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.025772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.026082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.026421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.026822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.027083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.027352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.027684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.027997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.028298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.028607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.028926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.029239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.029646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.029872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.030175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.030512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.030831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.031142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.031452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.031759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.032066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.032224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:15:04.032714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.032860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:15:04.033010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.033160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:15:04.033340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.033499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:15:04.033642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.033781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:15:04.033929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.033929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.034215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.034411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.034574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.034727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.034897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.035045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.035216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.035385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.035544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.035688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.035855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.036007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.036185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.036328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.036485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.036637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.036789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.036789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.037294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.037294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.038157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.038336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.038497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855479-1-iscsi {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.038651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.038651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.038950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.039349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.039510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.039653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.040754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.040943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.041095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.041307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.041456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.041597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.041737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.041883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.042034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.042184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.042376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.042543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.042703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.042867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.043028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.043170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.043317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.043457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.043606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.043747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.043906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.044056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.044201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.044342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.044488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.044649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.044789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.044935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.045084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.045231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.045371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.045520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.045669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855479-1-iscsi {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.045817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.045957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.046097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.046249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.046437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.046586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.046747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.046747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.047031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.047233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.047431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.047585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.047768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.047946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.048111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.048302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.048453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.048613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.048790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.048940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.049100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.049241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.049379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.049518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.049665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.049807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.050601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.050701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.050785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.050873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.050953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.051025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.051104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.051183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.051254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.051332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.051403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.051487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.051559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.051559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.051707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.051785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.051856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.051939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.052010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.052079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.052153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.052224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.052297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.052374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.052452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.052523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.052619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.052708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.052800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.052872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.052957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.053049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.053140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.053231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.053575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.054275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.054385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.054466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.054621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.054711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.054936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.055125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.055276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.055419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.055550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.055655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.055873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.055965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.056195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.056319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.056524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.056636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.056836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.056942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.057152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.057247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.057471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.057581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.057782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.057887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.058095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.058204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.058438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.058551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.058745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.058844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.059069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.059165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.059377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.059467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.059685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.059784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.060001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.060090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.060318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.060425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.060630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.060741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.060946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.061040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.061262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.061397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.061576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.061721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.061863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.061998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.062136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.062306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.062439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.062586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.062750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.062882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.063063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.063209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.063376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.063516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.063680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.063819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.063991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.064169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.064302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.064398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.064611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.064712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.064930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.065032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.065242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.065345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.065547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.065643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.065853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.065950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.066153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.066249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.066485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.066577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.066793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.066891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.067094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.067227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.067404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.067557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.067715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.067858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.068005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.068100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.068308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.068413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.068611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.068708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.068918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.069017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.069225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.069314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.070095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.070471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.070628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.070724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.070855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.071013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.071124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.071343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.071455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.071655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.071747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.071966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.072068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.072288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.072390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.072591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.072722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.072898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.073030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.073212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.073397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.073543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.073678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.073817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.073935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.074117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.074250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.074463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.074669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.074828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.074967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.075112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.075248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.075367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.075554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.075714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.075854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.076009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.076273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.076596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.076834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.076924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.077168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.077263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.077504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.077598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.077830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:15:04.077937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.078161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.078300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.078515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.078640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.078838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.078925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.079158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.079263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.079566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.079662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.079810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.079891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.081323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.081444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.081549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.081646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.081738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.081824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.081916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.082844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.083154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.083695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.083810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.084930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.085205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.085365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.085538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.085690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.085879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.086012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.086215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.086345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.086560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.086653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.086911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.087008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.087255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.087354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.087577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.087675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.087893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.087982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.088209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.088307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.088516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.088614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.088839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.089002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.089150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.089261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.089450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.089552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.089754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.089857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.090068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.090176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.090417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.090510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.090836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.090948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.091055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.091288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.091523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.091662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.091798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.091948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.091948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.092249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.092397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.092544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.092683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.092830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.092979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.093126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.093266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.093404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.093541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.093725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.093873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.094007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.094235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.094363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.094459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.094544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.094700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.094810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.095030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.095120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.095343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.095434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.095660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.095757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.095965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.096065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.096273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.096374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.096587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.096684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.096891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.096990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.097204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.097302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.097519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.097609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.097825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.097922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.098375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.098478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.098478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.098645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.098788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.098903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.099102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.099191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.099414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.099511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.099987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.100117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.100290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.100387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.100603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.100740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.101033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.101161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.101316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.101621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.101713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.101853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.101953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.102182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.102485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.102588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.102675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.102853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.102955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.103181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.103271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.103498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.103600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.103814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.103913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.104130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.104235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.104438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.104539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.104747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.104838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.105058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.105150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.105364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.105455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.105676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.105775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.105981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.106077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.106314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.106420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.106621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.106712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.106934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.107025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.107238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.107336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.107543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.107642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.107846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.107969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.108166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.108260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.108457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.108548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.108760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.108863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.109068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.109157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.109370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.109458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.109672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.109775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.109977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.110074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.110298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.110401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.110607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.110711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.110912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.111001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.111229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.111347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.111533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.111632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.111838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.111936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.112143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.112232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.112487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.112585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.112794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.112891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.113098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.113185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.113422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.113519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.113729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.113821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.114033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.114121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.114508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.114602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.114687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.114777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.114963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.115146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.115300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.115392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.115601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.115691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.115916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.116019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.116229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.116883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.117097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.117258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.117399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.117565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.117737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.117821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.118003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.118094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.118343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.118454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.118656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.118747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.118961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.119063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.119265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.119357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.119578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.119682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.119887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.119978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.120192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.120293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.120503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.120594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.120806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.120895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.121122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.121236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.121427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.121530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.121728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.121823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.122032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.122126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.122369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.122506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.122682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.122784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.122986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.123078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.123313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.123402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.123622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.123729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.123927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.124025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.124234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.124377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.124546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.124646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.124851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.124948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.125159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.125260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.125471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.125572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.125793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.125891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.126103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.126199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.126442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.126544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.126768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.126859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.127072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.127161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.127380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.127472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.127686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.127783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.127991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.128127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.128291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.128381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.128593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.128685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.128895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.128993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.129199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.129290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.129501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.129592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.129803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.129907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.130120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.130217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.130451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.130557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.130756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.130861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.131059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.131148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.131369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.131588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.131715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.131838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.132801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.132903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.132997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.133090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.133181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.133276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.133457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.133550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.133763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.133864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.134085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.134177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.134421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.134526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.134725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.134823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.135027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.135117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.135332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.135426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.135647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.135742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.135951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.136049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.136254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.136345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.136572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.136709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.136898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.137005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.137212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.137303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.137527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.137618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.137840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.137940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.138152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.138249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.138480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.138583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.138792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.138890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.139104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.139193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.139410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.139508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.139721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.139818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.140033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.140122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.140344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.140478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.140658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.140748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.140968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.141065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.141279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.141383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.141600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.141769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.141929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.142048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.142201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.142325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.142540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.142632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.142847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.143117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.143223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.143454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.143544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.143762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.143859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.144076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.144177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.144384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.144474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.144696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.144790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.145007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.145147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.145369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.145466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.145686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.145778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.145994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.146136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.146324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.146419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.146632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.146735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.146937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.147035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.147250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.147342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.147590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.147691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.147899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.147996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.148269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.148368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.148583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.148682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.148888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.148978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.149193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.149298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.149500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.149599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.149798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.149886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.150110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.150207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.150442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.150534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.150752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.150842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.151053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.151155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.151354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.151450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.151737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.151840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.151977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.152076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.152281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.152419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.152585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.152701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.152927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.153026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.153233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.153324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.153571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.153711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.153901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.154025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.154241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.154420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.154569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.154707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.154881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.154979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.155205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.155346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.155510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.155618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.155814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.155905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.156115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.156277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.156426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.156533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.156736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.156829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.157036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.157126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.157347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.157446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.157656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.157747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.157968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.158066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.158293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.158389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.158597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.158702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.158907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.159006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.159209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.159367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.159522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.159695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.159829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.160010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.160133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.160335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.160426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.160662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.160753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.160969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.161070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.161276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.161380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.161592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.161689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.161900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.162010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.162201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.162304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.162529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.162666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.162834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.162926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.163679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.163788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.164001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.164090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.164317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.164416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.164624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.164722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.164931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.165025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.165260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.165359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.165567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.165669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.165869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.165967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.166184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.166314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.166514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.166608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.166819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.166924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.167134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.167225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.167454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.167549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.167767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.167867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.168070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.168167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.168372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.168469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.168675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.168773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.168982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.169080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.169553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.169651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.169749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.169840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.169924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.170007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.170162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.170277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.170488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.170588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.170797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.170898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.171096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.171228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.171420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.171565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.171734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.171887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.172033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.172213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.172325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.172517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.172644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.172823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.172948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.173136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.173236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.173441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.173602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.173752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.173907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.174053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.174224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.174386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.174569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.174691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.174889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.174989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.175203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.175292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.175519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.175705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.175829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.175943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.176146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.176246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.176462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.176572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.176777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.176891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.177077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.177175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.177380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.177483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.177701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.177801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.178010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.178106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.178344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.178455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.178667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.178797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.179547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.179640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.179871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.179962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.180245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.180334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.180559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.180648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.180875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.180967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.181189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.181288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.181503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.181600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.181816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.181914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.182125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.182215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.182464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.182556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.182784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.182928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.183097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.183199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.183409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.183650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.183770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.184006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.184112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.184300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.184398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.184611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.184717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.184921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.185057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.185241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.185333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.185545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.185672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.185857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.185960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.186164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.186286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.186502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.186647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.186812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.186917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.187137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.187242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.187462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.187560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.187796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.187914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.188126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.188234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.188436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.188534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.188749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.188841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.189061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.189160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.189376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.189473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.189683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.189773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.190032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.190122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.190364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.190473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.190681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.190773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.190999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.191090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.191315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.191405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.191618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.191708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.191931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.192022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.192247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.192336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.192549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.192649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.192855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.192953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.193160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.193251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.193472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.193575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.193778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.193868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.194100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.194199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.194554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.194662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.194879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.194976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.195294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.195383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.195613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.195730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.195933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.196035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.196350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.196451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.196675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.196816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.197000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.197103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.197323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.197423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.197631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.197724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.197949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.198053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.198306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.198420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.198609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.198703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.198934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.199033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.199247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.199346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.199563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.199662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.199867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.199964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.200169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.200268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.200493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.200585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.200807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.200907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.201114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.201217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.201440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.201538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.201753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.201845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.202144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.202374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.202480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.202731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.202829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.203049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.203197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.203374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.203509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.203689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.203786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.203996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.204097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.204301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.204389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.204622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.204719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.204929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.205033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.205241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.205339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.205554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.205645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.205863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.206074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.206164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.206309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.206483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.206585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.206797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.206929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.207100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.207190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.207405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.207494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.207717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.207822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.208033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.208183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.208349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.208441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.208653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.208745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.208957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.209053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.209264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.209355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.209565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.209662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.209870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.209961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.210201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.210322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.210538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.210689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.210845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.211001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.211160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.211328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.211467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.211660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.211781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.211992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.212092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.212307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.212405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.212643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.212735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.212974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.213110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.213298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.213390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.213620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.213719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.213943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.214049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.214248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.214404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.214578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.214698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.214896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.215004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.215205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.215349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.215515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.215619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.215819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.215923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.216224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.216332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.216426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.216567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.216720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.217024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.217160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.217345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.217447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.217650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.217751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.217974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.218100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.218302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.218439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.218612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.218740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.218918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.219013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.219222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.219320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.219561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.219665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.219867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.219956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.220179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.220276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.220494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.220594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.220808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.220899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.221121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.221212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.221435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.221533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.221749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.221867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.222062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.222156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.222401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.222508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.222714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.222807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.223025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.223123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.223356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.223444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.223653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.223740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.223967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.224065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.224283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.224384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.224890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.225106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.225206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.225439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.225530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.226336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.226551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.226696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.226902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.227008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.227220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.227310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.227537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.227641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.227852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.227957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.228166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.228257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.228479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.228588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.228789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.228882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.229110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.229209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.229420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.229513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.229744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.229835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.230082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.230173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.230427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.230535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.230746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.230844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.231062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.231161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.231381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.231485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.231722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.231815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.232038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.232137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.232345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.232445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.232661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.232789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.232979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.233069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.233301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.233435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.233622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.233720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.233937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.234032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.234241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.234398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.234570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.234688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.234875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.234979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.235186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.235283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.235507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.235607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.235815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.235988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.236122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.236221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.236426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.236517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.236739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.236840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.237043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.237133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.237347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.237437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.237651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.237758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.237954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.238189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.238322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.238534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.238638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.238869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.238966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.239171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.239261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.239473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.239573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.239776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.239882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.240079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.240179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.240388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.240492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.240692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.240783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.240996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.241086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.241867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.241980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.242189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.242317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.242522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.242743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.242873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.243090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.243183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.243429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.243527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.243750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.243849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.244064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.244158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.244379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.244598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.244690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.244952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.245044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.245270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.245360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.245601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.245699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.245928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.246020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.246238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.246366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.246567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.246675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.246894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.246993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.247204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.247296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.247513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.247617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.247826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.247925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.248136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.248234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.248442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.248546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.248749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.248848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.249063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.249155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.249376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.249476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.249683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.249781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.249995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.250086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.250322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.250437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.250648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.250738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.250953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.251042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.251260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.251358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.251567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.251658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.251877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.251975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.252183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.252282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.252490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.252588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.252797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.252897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.253103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.253198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.253412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.253508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.253715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.253819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.254028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.254163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.254355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.254462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.254673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.254778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.254979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.255071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.255294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.255388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.255622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.255725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.255948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.256090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.256299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.256409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.256615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.256750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.257011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.257113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.257278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.257403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.257721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.257849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.258035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.258128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.258368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.258477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.258616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:15:04.258739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.259061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.259600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.259934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.260257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.260595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.260929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.261238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.261544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.261850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.262178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.262516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.262832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.263147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.263461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.263776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.264088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.264402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.264715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.265028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.265339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.265656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.265966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.266296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.266611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.266931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.267277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.267601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.267923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.268243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.268561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.268873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.269185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.269497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.269808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.270126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.270483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.270798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.271105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.271539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.271860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.272184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.272539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.273000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.273330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.273653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.273970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.274315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.274632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.274963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.275306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.275640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.275967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.276274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.276580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.276883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.277195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.277513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.277821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.278121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.278449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.278762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.279066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.279369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.279671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.279972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.280280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.280581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.280882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.281184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.281486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.281788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.282090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.282422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.282809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.283038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.283341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.283645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.283947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.284278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.284612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.284930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.285253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.285572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.285893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.286204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.286549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.286871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.287191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.287502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.287839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.288677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.288993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.289305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.289728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.290047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.290388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.290723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.291052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.291362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.291691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.292011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.292334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.292650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.292966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.293293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.293605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.293918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.294232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.294567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.294880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.295198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.295516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.295828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.296146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.296463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.296789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.297114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.297426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.297751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.298076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.298452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.298770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.299116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.299446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.299760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.300074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.300380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:15:04.300624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:15:04.320329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO dbcounter [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Registered counter for database nova_api Sep 01 08:15:04.341623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_db.sqlalchemy.engines [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.348597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writer thread running {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.367000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO dbcounter [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Registered counter for database nova_api Sep 01 08:15:04.387609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.394304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writer thread running {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.407026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.context [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68db8b0b-4cf2-486d-b60d-ca583ee6448a(cell1) {{(pid=120752) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 08:15:04.411095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:15:04.411610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:15:04.413275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:15:04.414051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:15:04.414527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:15:04.416575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:15:04.418941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO dbcounter [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Registered counter for database nova_cell0 Sep 01 08:15:04.423115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO dbcounter [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Registered counter for database nova_cell1 Sep 01 08:15:04.430847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_db.sqlalchemy.engines [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.432233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_db.sqlalchemy.engines [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.441747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writer thread running {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.443093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writer thread running {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.451132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.context [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68db8b0b-4cf2-486d-b60d-ca583ee6448a(cell1) {{(pid=120753) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 08:15:04.455397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:15:04.455949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:15:04.457544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:15:04.458443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:15:04.458897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:15:04.461657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:15:04.463848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO dbcounter [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Registered counter for database nova_cell0 Sep 01 08:15:04.468337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO dbcounter [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Registered counter for database nova_cell1 Sep 01 08:15:04.476445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.478313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.484388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writer thread running {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.486463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writer thread running {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.595411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO dbcounter [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Registered counter for database nova_cell0 Sep 01 08:15:04.602660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_db.sqlalchemy.engines [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.607591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writer thread running {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.642437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO dbcounter [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Registered counter for database nova_cell0 Sep 01 08:15:04.652069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:15:04.659493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writer thread running {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:15:04.937328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: WARNING keystonemiddleware.auth_token [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:15:04.945209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: WARNING keystonemiddleware.auth_token [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:15:05.126976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: WARNING keystonemiddleware.auth_token [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:15:05.135549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: WARNING keystonemiddleware.auth_token [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:15:05.302397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: WARNING keystonemiddleware.auth_token [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:15:05.310022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: WARNING keystonemiddleware.auth_token [None req-40cd0b95-7215-4eb1-b4c6-aea77abd73c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:15:05.315711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d52ed19c0 pid: 120752 (default app) Sep 01 08:15:05.482781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: WARNING keystonemiddleware.auth_token [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 08:15:05.489302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: WARNING keystonemiddleware.auth_token [None req-bdf9a663-3fcd-4c4b-8dff-9366cb738cf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 08:15:05.496383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d52ed19c0 pid: 120753 (default app) Sep 01 08:15:45.238951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.248453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.251743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.254491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.400256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.401731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.403334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.404628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.433861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e60fee10-7d9f-46fb-83ae-9e97d63d1b05 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Action: 'create', calling method: .version_select at 0x7f2ac02e3160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1752207726"}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:15:48.632945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-563ffe10-39a0-41a9-9244-21ab794c3d9c tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Action: 'create', calling method: .version_select at 0x7f2ac02e20d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1761554221", "metadata": {"Type": "work"}}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-563ffe10-39a0-41a9-9244-21ab794c3d9c tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Request method failure captured: Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 122 Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGozWXKDaLpx-ep9LyeFRrySkGADtDIxUzXZAVF9g4X3onWI7sZ23e_vIWO9q4S-7ltFV1lAc1Dd2BjnI1Jfd7y5ZGpt1NlO8yf8h6CcprxMH_MxSEkVK9-_yqBD7Cngc0cH4X-ISeUWtMhCH22BJTdChQpMsn6KFeNqPEhYweIjAPo Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:48.642453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fc1b2d8410c24838992be4ea0d1667db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 0381f64a943848fb887248531104b4b2 Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1761554221", "metadata": {"Type": "work"}}} Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:48.644265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1761554221', 'metadata': {'Type': 'work'}}}} Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise error Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:48.650531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 08:15:48.653221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 08:15:48.656616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 08:15:48.656616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.657648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-563ffe10-39a0-41a9-9244-21ab794c3d9c tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:48.659084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-563ffe10-39a0-41a9-9244-21ab794c3d9c tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.286824 Sep 01 08:15:48.660374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Sep 1 08:15:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 08:15:48.681412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a902de2-e7af-41a6-b5d9-094d23247d81 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Action: 'create', calling method: .version_select at 0x7f2ac02e2dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-327458014", "metadata": {"Type": "work"}}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a902de2-e7af-41a6-b5d9-094d23247d81 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Request method failure captured: Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 119 Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGozWXKDaLpx-ep9LyeFRrySkGADtDIxUzXZAVF9g4X3onWI7sZ23e_vIWO9q4S-7ltFV1lAc1Dd2BjnI1Jfd7y5ZGpt1NlO8yf8h6CcprxMH_MxSEkVK9-_yqBD7Cngc0cH4X-ISeUWtMhCH22BJTdChQpMsn6KFeNqPEhYweIjAPo Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:48.689607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fc1b2d8410c24838992be4ea0d1667db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 0381f64a943848fb887248531104b4b2 Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-327458014", "metadata": {"Type": "work"}}} Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:48.692139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-327458014', 'metadata': {'Type': 'work'}}}} Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise error Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi '0' Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:48.695993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 08:15:48.704252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 08:15:48.708245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 08:15:48.708245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.708245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a902de2-e7af-41a6-b5d9-094d23247d81 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:48.710151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2a902de2-e7af-41a6-b5d9-094d23247d81 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029565 Sep 01 08:15:48.719564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Sep 1 08:15:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 08:15:48.729092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0c19e87-ad1b-442b-8553-dc07fb250c98 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Action: 'create', calling method: .version_select at 0x7f2ac0208ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1691656828", "metadata": {"Type": "work"}}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0c19e87-ad1b-442b-8553-dc07fb250c98 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Request method failure captured: Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 119 Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGozWXKDaLpx-ep9LyeFRrySkGADtDIxUzXZAVF9g4X3onWI7sZ23e_vIWO9q4S-7ltFV1lAc1Dd2BjnI1Jfd7y5ZGpt1NlO8yf8h6CcprxMH_MxSEkVK9-_yqBD7Cngc0cH4X-ISeUWtMhCH22BJTdChQpMsn6KFeNqPEhYweIjAPo Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:48.736624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fc1b2d8410c24838992be4ea0d1667db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 0381f64a943848fb887248531104b4b2 Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1691656828", "metadata": {"Type": "work"}}} Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:48.739141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1691656828', 'metadata': {'Type': 'work'}}}} Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise error Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi '' Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:48.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 08:15:48.745471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 08:15:48.752675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 08:15:48.752675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:48.753835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0c19e87-ad1b-442b-8553-dc07fb250c98 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:48.756617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d0c19e87-ad1b-442b-8553-dc07fb250c98 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034105 Sep 01 08:15:48.767438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 3/3] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Sep 1 08:15:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 08:15:48.780679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-96fe4cad-1321-4624-b4a7-a32935d29c05 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Calling method '.version_select at 0x7f2ac02089d0>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:49.304520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-96fe4cad-1321-4624-b4a7-a32935d29c05 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] HTTP exception thrown: Volume tempest-invalid-1451996189 could not be found. Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-96fe4cad-1321-4624-b4a7-a32935d29c05 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Request method failure captured: Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1451996189 HTTP/1.1 Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGozWXKDaLpx-ep9LyeFRrySkGADtDIxUzXZAVF9g4X3onWI7sZ23e_vIWO9q4S-7ltFV1lAc1Dd2BjnI1Jfd7y5ZGpt1NlO8yf8h6CcprxMH_MxSEkVK9-_yqBD7Cngc0cH4X-ISeUWtMhCH22BJTdChQpMsn6KFeNqPEhYweIjAPo Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:49.315638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fc1b2d8410c24838992be4ea0d1667db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 0381f64a943848fb887248531104b4b2 Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Volume tempest-invalid-1451996189 could not be found. Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': 'tempest-invalid-1451996189'} Sep 01 08:15:49.320560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1451996189 could not be found. (HTTP 404) (Request-ID: req-2006c25d-47e7-4861-8cf9-00b5e5078967) Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.322551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 08:15:49.325642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1451996189 could not be found. Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:15:49.328598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1451996189 could not be found. Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1451996189 could not be found. Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.331411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-96fe4cad-1321-4624-b4a7-a32935d29c05 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Returning 404 to user: Volume tempest-invalid-1451996189 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:49.338538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-96fe4cad-1321-4624-b4a7-a32935d29c05 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1451996189" status: 404 len: 99 microversion: 2.1 time: 0.559265 Sep 01 08:15:49.338538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 4/4] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Sep 1 08:15:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1451996189 => generated 99 bytes in 567 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 08:15:49.371058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a5d6dd3-13d3-4cb3-811d-b6042f089f37 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.023781 Sep 01 08:15:49.371947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 5/5] 10.222.0.43 () {58 vars in 1140 bytes} [Thu Sep 1 08:15:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 08:15:49.386127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7cf0d25c-9881-4f53-a7ec-cb02bf13815b tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006533 Sep 01 08:15:49.392123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 6/6] 10.222.0.43 () {58 vars in 1137 bytes} [Thu Sep 1 08:15:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 08:15:49.407745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7734e493-9a93-47ee-8bec-6f9eaf669dfd tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Calling method '.version_select at 0x7f2ac0137f70>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:49.578864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-7734e493-9a93-47ee-8bec-6f9eaf669dfd tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] HTTP exception thrown: Volume f5ee6133-beda-487b-bbde-997bbf0294d5 could not be found. Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7734e493-9a93-47ee-8bec-6f9eaf669dfd tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Request method failure captured: Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: DELETE /compute/v2.1/os-volumes/f5ee6133-beda-487b-bbde-997bbf0294d5 HTTP/1.1 Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGozWXKDaLpx-ep9LyeFRrySkGADtDIxUzXZAVF9g4X3onWI7sZ23e_vIWO9q4S-7ltFV1lAc1Dd2BjnI1Jfd7y5ZGpt1NlO8yf8h6CcprxMH_MxSEkVK9-_yqBD7Cngc0cH4X-ISeUWtMhCH22BJTdChQpMsn6KFeNqPEhYweIjAPo Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:49.582993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fc1b2d8410c24838992be4ea0d1667db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 0381f64a943848fb887248531104b4b2 Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Volume f5ee6133-beda-487b-bbde-997bbf0294d5 could not be found. Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': 'f5ee6133-beda-487b-bbde-997bbf0294d5'} Sep 01 08:15:49.584854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5ee6133-beda-487b-bbde-997bbf0294d5 could not be found. (HTTP 404) (Request-ID: req-b650246c-f14a-4aa3-af88-1c1839ce5bf4) Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.585840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 08:15:49.587043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5ee6133-beda-487b-bbde-997bbf0294d5 could not be found. Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 08:15:49.588148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5ee6133-beda-487b-bbde-997bbf0294d5 could not be found. Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5ee6133-beda-487b-bbde-997bbf0294d5 could not be found. Sep 01 08:15:49.589237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.599470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7734e493-9a93-47ee-8bec-6f9eaf669dfd tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Returning 404 to user: Volume f5ee6133-beda-487b-bbde-997bbf0294d5 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:49.601182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7734e493-9a93-47ee-8bec-6f9eaf669dfd tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/f5ee6133-beda-487b-bbde-997bbf0294d5" status: 404 len: 109 microversion: 2.1 time: 0.202216 Sep 01 08:15:49.603191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 7/7] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Sep 1 08:15:49 2022] DELETE /compute/v2.1/os-volumes/f5ee6133-beda-487b-bbde-997bbf0294d5 => generated 109 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:15:49.619122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ccc4baef-fae1-46d6-9379-90ffd1542853 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Calling method '.version_select at 0x7f2ac019eb80>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:49.710441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-ccc4baef-fae1-46d6-9379-90ffd1542853 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] HTTP exception thrown: Volume c9058395-aa48-442d-90c8-c7d23de47d5b could not be found. Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ccc4baef-fae1-46d6-9379-90ffd1542853 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Request method failure captured: Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/os-volumes/c9058395-aa48-442d-90c8-c7d23de47d5b HTTP/1.1 Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGozWXKDaLpx-ep9LyeFRrySkGADtDIxUzXZAVF9g4X3onWI7sZ23e_vIWO9q4S-7ltFV1lAc1Dd2BjnI1Jfd7y5ZGpt1NlO8yf8h6CcprxMH_MxSEkVK9-_yqBD7Cngc0cH4X-ISeUWtMhCH22BJTdChQpMsn6KFeNqPEhYweIjAPo Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:49.713783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fc1b2d8410c24838992be4ea0d1667db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fc1b2d8410c24838992be4ea0d1667db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: fc1b2d8410c24838992be4ea0d1667db Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesNegativeTest-173800825 Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 0381f64a943848fb887248531104b4b2 Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesNegativeTest-173800825-project Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Volume c9058395-aa48-442d-90c8-c7d23de47d5b could not be found. Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': 'c9058395-aa48-442d-90c8-c7d23de47d5b'} Sep 01 08:15:49.715307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9058395-aa48-442d-90c8-c7d23de47d5b could not be found. (HTTP 404) (Request-ID: req-9ed9362a-9d8b-4352-97a3-79b37561df50) Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:49.717578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9058395-aa48-442d-90c8-c7d23de47d5b could not be found. Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 08:15:49.718758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9058395-aa48-442d-90c8-c7d23de47d5b could not be found. Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9058395-aa48-442d-90c8-c7d23de47d5b could not be found. Sep 01 08:15:49.719969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:49.721736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ccc4baef-fae1-46d6-9379-90ffd1542853 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] Returning 404 to user: Volume c9058395-aa48-442d-90c8-c7d23de47d5b could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:49.730564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ccc4baef-fae1-46d6-9379-90ffd1542853 tempest-VolumesNegativeTest-173800825 tempest-VolumesNegativeTest-173800825-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c9058395-aa48-442d-90c8-c7d23de47d5b" status: 404 len: 109 microversion: 2.1 time: 0.119716 Sep 01 08:15:49.733666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 8/8] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:15:49 2022] GET /compute/v2.1/os-volumes/c9058395-aa48-442d-90c8-c7d23de47d5b => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:15:50.047662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e60fee10-7d9f-46fb-83ae-9e97d63d1b05 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.840074 Sep 01 08:15:50.048810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1/9] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Sep 1 08:15:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4845 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 08:15:50.064489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4cb9302-e302-4649-982f-d7fe4cf636c9 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac02089d0>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:50.187776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4cb9302-e302-4649-982f-d7fe4cf636c9 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3" status: 200 len: 345 microversion: 2.1 time: 0.127862 Sep 01 08:15:50.188914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 9/10] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:15:50 2022] GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:51.202154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e53ab9c-58f8-41fb-bb87-8005ee6fa847 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac01c7040>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:51.371245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e53ab9c-58f8-41fb-bb87-8005ee6fa847 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3" status: 200 len: 346 microversion: 2.1 time: 0.173443 Sep 01 08:15:51.372430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2/11] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:15:51 2022] GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 => generated 346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:51.385383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-765755f0-59b7-4467-b16a-b0239b7a4950 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Action: 'create', calling method: .version_select at 0x7f2ac0137700>, body: {"snapshot": {"volume_id": "7802d9d2-873f-474f-b261-e30c768329b3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1577060396"}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:15:51.839773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-765755f0-59b7-4467-b16a-b0239b7a4950 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.457993 Sep 01 08:15:51.842571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 10/12] 10.222.0.43 () {60 vars in 1162 bytes} [Thu Sep 1 08:15:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:15:51.857665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fe29a03d-644c-4462-8e70-0baf6cf48d02 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac01c7700>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:52.121980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fe29a03d-644c-4462-8e70-0baf6cf48d02 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 200 len: 287 microversion: 2.1 time: 0.271883 Sep 01 08:15:52.122944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 3/13] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Sep 1 08:15:51 2022] GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 287 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:52.141264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3cd26386-5ddd-46cc-bca2-f0736400762d tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac00d3ee0>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:52.276940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3cd26386-5ddd-46cc-bca2-f0736400762d tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.144407 Sep 01 08:15:52.278585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 11/14] 10.222.0.43 () {58 vars in 1140 bytes} [Thu Sep 1 08:15:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:52.296988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2ca5f0dc-fc4d-42a1-8186-1b35c7392721 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac01c7e50>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:52.408686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2ca5f0dc-fc4d-42a1-8186-1b35c7392721 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 200 len: 287 microversion: 2.1 time: 0.122172 Sep 01 08:15:52.415570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 4/15] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Sep 1 08:15:52 2022] GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:53.422024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-89227b3a-b991-4fe2-8d4f-4292566d4097 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac00d3940>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:53.519820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-89227b3a-b991-4fe2-8d4f-4292566d4097 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 200 len: 287 microversion: 2.1 time: 0.100461 Sep 01 08:15:53.521347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 12/16] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Sep 1 08:15:53 2022] GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:54.537895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-add64717-8201-4872-a8cf-d772dbf759bd tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac01c7ca0>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:54.661029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-add64717-8201-4872-a8cf-d772dbf759bd tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 200 len: 287 microversion: 2.1 time: 0.130933 Sep 01 08:15:54.664068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 5/17] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Sep 1 08:15:54 2022] GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:55.683627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8ce30fbd-ce34-48d0-847b-29701c283940 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac0137940>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:55.778926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8ce30fbd-ce34-48d0-847b-29701c283940 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 200 len: 288 microversion: 2.1 time: 0.097258 Sep 01 08:15:55.780352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 13/18] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Sep 1 08:15:55 2022] GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:55.796597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee6b953a-d19e-4d8c-b06d-8ce2ac2e6600 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac01c7550>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:56.058983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee6b953a-d19e-4d8c-b06d-8ce2ac2e6600 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 202 len: 0 microversion: 2.1 time: 0.269458 Sep 01 08:15:56.065535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 6/19] 10.222.0.43 () {58 vars in 1254 bytes} [Thu Sep 1 08:15:55 2022] DELETE /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 08:15:56.075714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b15b419-4f7e-46f0-84d7-5caf97613642 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac0137b80>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:56.166562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b15b419-4f7e-46f0-84d7-5caf97613642 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 200 len: 287 microversion: 2.1 time: 0.098724 Sep 01 08:15:56.167707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 14/20] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Sep 1 08:15:56 2022] GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:57.186101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-208689d6-d733-4a37-a64f-06a798c211a1 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac01b3ee0>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:57.313484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-208689d6-d733-4a37-a64f-06a798c211a1 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] HTTP exception thrown: Snapshot 9f3cc1da-6207-459e-846e-1d91bcbb0c55 could not be found. Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-208689d6-d733-4a37-a64f-06a798c211a1 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Request method failure captured: Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 HTTP/1.1 Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGoxH3lWSEVgjyhljw5haKQzij3l2GMuRbizg5eDj9pCmwGmr5BsZyH9n66UYjNjbRX_B_Lmk1ZZZquJYWqsqh1cmEsWMimZ609-Sf7TGSxvNHi5XocZFzP1FgM4L6aV3LuNepMOS4chkDq53H0coJr8oHxDUVkm23MGpLYjnNsF8TI Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:15:57.330180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5659ecaff9de446cbf9c79f301c0b994", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: cc8ef450fa994dd2a17d1815750f5dd3 Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Snapshot 9f3cc1da-6207-459e-846e-1d91bcbb0c55 could not be found. Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '9f3cc1da-6207-459e-846e-1d91bcbb0c55'} Sep 01 08:15:57.333139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9f3cc1da-6207-459e-846e-1d91bcbb0c55 could not be found. (HTTP 404) (Request-ID: req-ef0ef9ea-a183-4dad-9f47-703d1f64110d) Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:57.336922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:57.339332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9f3cc1da-6207-459e-846e-1d91bcbb0c55 could not be found. Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 08:15:57.341617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9f3cc1da-6207-459e-846e-1d91bcbb0c55 could not be found. Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9f3cc1da-6207-459e-846e-1d91bcbb0c55 could not be found. Sep 01 08:15:57.348459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:57.361116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-208689d6-d733-4a37-a64f-06a798c211a1 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Returning 404 to user: Snapshot 9f3cc1da-6207-459e-846e-1d91bcbb0c55 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:57.372407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-208689d6-d733-4a37-a64f-06a798c211a1 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55" status: 404 len: 111 microversion: 2.1 time: 0.186114 Sep 01 08:15:57.377809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 7/21] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Sep 1 08:15:57 2022] GET /compute/v2.1/os-snapshots/9f3cc1da-6207-459e-846e-1d91bcbb0c55 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:15:57.398165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-342c3c16-aa3f-4479-b7b4-b95fa55b59fc tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac0137700>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:57.673381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-342c3c16-aa3f-4479-b7b4-b95fa55b59fc tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3" status: 202 len: 0 microversion: 2.1 time: 0.287796 Sep 01 08:15:57.682365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 15/22] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Sep 1 08:15:57 2022] DELETE /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 08:15:57.687381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-56559be0-67b7-49c1-8109-08716ad69917 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac0126790>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:57.860606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-56559be0-67b7-49c1-8109-08716ad69917 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3" status: 200 len: 345 microversion: 2.1 time: 0.177063 Sep 01 08:15:57.861194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 8/23] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:15:57 2022] GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:15:58.884948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-746a9534-96dd-4364-9855-4031ea20a33d tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac00d3f70>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:58.928827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-746a9534-96dd-4364-9855-4031ea20a33d tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] HTTP exception thrown: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-746a9534-96dd-4364-9855-4031ea20a33d tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Request method failure captured: Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 HTTP/1.1 Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGoxH3lWSEVgjyhljw5haKQzij3l2GMuRbizg5eDj9pCmwGmr5BsZyH9n66UYjNjbRX_B_Lmk1ZZZquJYWqsqh1cmEsWMimZ609-Sf7TGSxvNHi5XocZFzP1FgM4L6aV3LuNepMOS4chkDq53H0coJr8oHxDUVkm23MGpLYjnNsF8TI Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:58.941935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5659ecaff9de446cbf9c79f301c0b994", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: cc8ef450fa994dd2a17d1815750f5dd3 Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '7802d9d2-873f-474f-b261-e30c768329b3'} Sep 01 08:15:58.943441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. (HTTP 404) (Request-ID: req-20965c46-a5b2-41f2-b852-6ae06beda190) Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:58.944307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:58.945419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 08:15:58.947689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-746a9534-96dd-4364-9855-4031ea20a33d tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Returning 404 to user: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-746a9534-96dd-4364-9855-4031ea20a33d tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3" status: 404 len: 109 microversion: 2.1 time: 0.069761 Sep 01 08:15:58.950632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 16/24] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:15:58 2022] GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:15:58.962351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-de1235f3-fff8-404c-973a-6d9ad0ae3ef3 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac0126e50>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:59.068843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-de1235f3-fff8-404c-973a-6d9ad0ae3ef3 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] HTTP exception thrown: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-de1235f3-fff8-404c-973a-6d9ad0ae3ef3 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Request method failure captured: Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: DELETE /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 HTTP/1.1 Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGoxH3lWSEVgjyhljw5haKQzij3l2GMuRbizg5eDj9pCmwGmr5BsZyH9n66UYjNjbRX_B_Lmk1ZZZquJYWqsqh1cmEsWMimZ609-Sf7TGSxvNHi5XocZFzP1FgM4L6aV3LuNepMOS4chkDq53H0coJr8oHxDUVkm23MGpLYjnNsF8TI Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:15:59.073062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5659ecaff9de446cbf9c79f301c0b994", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: cc8ef450fa994dd2a17d1815750f5dd3 Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '7802d9d2-873f-474f-b261-e30c768329b3'} Sep 01 08:15:59.074164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. (HTTP 404) (Request-ID: req-53a9a35c-6671-4284-9baa-330478d48486) Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:59.074905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 08:15:59.075810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 08:15:59.076718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-de1235f3-fff8-404c-973a-6d9ad0ae3ef3 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Returning 404 to user: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-de1235f3-fff8-404c-973a-6d9ad0ae3ef3 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3" status: 404 len: 109 microversion: 2.1 time: 0.117347 Sep 01 08:15:59.077583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 9/25] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Sep 1 08:15:58 2022] DELETE /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:15:59.084871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfcfe483-2299-4e75-b652-d176440f7af9 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Calling method '.version_select at 0x7f2ac01378b0>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:15:59.142185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-cfcfe483-2299-4e75-b652-d176440f7af9 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] HTTP exception thrown: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfcfe483-2299-4e75-b652-d176440f7af9 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Request method failure captured: Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 HTTP/1.1 Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGoxH3lWSEVgjyhljw5haKQzij3l2GMuRbizg5eDj9pCmwGmr5BsZyH9n66UYjNjbRX_B_Lmk1ZZZquJYWqsqh1cmEsWMimZ609-Sf7TGSxvNHi5XocZFzP1FgM4L6aV3LuNepMOS4chkDq53H0coJr8oHxDUVkm23MGpLYjnNsF8TI Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:15:59.144539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5659ecaff9de446cbf9c79f301c0b994", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5659ecaff9de446cbf9c79f301c0b994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 5659ecaff9de446cbf9c79f301c0b994 Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537244160 Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: cc8ef450fa994dd2a17d1815750f5dd3 Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537244160-project Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '7802d9d2-873f-474f-b261-e30c768329b3'} Sep 01 08:15:59.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. (HTTP 404) (Request-ID: req-773a6916-9c3d-4bd3-bfb2-9a5749c81792) Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:59.146328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:15:59.147222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 08:15:59.148182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfcfe483-2299-4e75-b652-d176440f7af9 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] Returning 404 to user: Volume 7802d9d2-873f-474f-b261-e30c768329b3 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfcfe483-2299-4e75-b652-d176440f7af9 tempest-VolumesSnapshotsTestJSON-537244160 tempest-VolumesSnapshotsTestJSON-537244160-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3" status: 404 len: 109 microversion: 2.1 time: 0.066005 Sep 01 08:15:59.149070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 17/26] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:15:59 2022] GET /compute/v2.1/os-volumes/7802d9d2-873f-474f-b261-e30c768329b3 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 08:16:05.156429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-690333526", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:16:05.426962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] validate_networks() for [('b2233808-8a34-44fc-b13b-29054ed6cb17', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:16:05.656687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1795752322", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "networks": [{"uuid": "935b3f17-4b0b-4f7b-8ce4-2c41a4f0e788"}]}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:16:05.940267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] validate_networks() for [('935b3f17-4b0b-4f7b-8ce4-2c41a4f0e788', None, None, None, None, None)] {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:16:11.306601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:16:11.308830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:16:11.310122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:16:11.311027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:16:11.311676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:16:11.363768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:11.365120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:11.368878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:11.369926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:11.372295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:11.374013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:11.455670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Getting quotas for project 7d43ea736fc0496d841b2530242dfde6. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:16:11.465218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Getting quotas for user 854e77042ee14f7f806a33f9c9501bb0 and project 7d43ea736fc0496d841b2530242dfde6. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:16:11.481988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:16:11.485656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: c475829b-c46b-4320-984b-1c5368564cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:16:11.654309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:16:11.655167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:16:11.656169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:16:11.671442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:16:11.672766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:16:11.712645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-96a1f915-cf1c-4db0-b084-34bf54c0aa77 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.449396 Sep 01 08:16:11.715892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 10/27] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:16:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 7454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:16:11.728764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:11.729147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:11.729783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:11.730743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:11.734379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:11.735877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:11.818438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Getting quotas for project e17cd7e07aa94984a3ecdb3fbce1b097. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:16:11.848357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Getting quotas for user c5d55971cbce4c61a81b158aa666e2ea and project e17cd7e07aa94984a3ecdb3fbce1b097. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:16:11.873773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:16:11.887126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:16:12.076717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-98b8ec73-7f0b-43fc-8397-5b9a882bb1bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.072913 Sep 01 08:16:12.088154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 18/28] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:16:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 7085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:16:12.098650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2a3f2b9-7af8-4b75-b3e8-ec247d10f980 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:12.118296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2a3f2b9-7af8-4b75-b3e8-ec247d10f980 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: c475829b-c46b-4320-984b-1c5368564cf8] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:12.499784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e96173e8-0ce9-4e6f-a2b1-ba25c7d5d209 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Action: 'create', calling method: .version_select at 0x7f2ac0037e50>, body: {"keypair": {"name": "tempest-keypair-1619341742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiPbZCHy3mKOsYrQYLr4kOz2J2VAVyGrscReCCFA8qlEBOO0mwXKyrIkMwcqMCbOuxh+B0BpVrCmakFk9blVwZRAewWQa9eXFU+SrcxCR+X843aSo0g9hxxTziR55wr5A=="}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:16:12.592668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-e96173e8-0ce9-4e6f-a2b1-ba25c7d5d209 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:16:12.602576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2a3f2b9-7af8-4b75-b3e8-ec247d10f980 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:12.630526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-e96173e8-0ce9-4e6f-a2b1-ba25c7d5d209 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for user eaf3d36d40d442019e09a3e4c32b8330 and project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:16:12.657928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2a3f2b9-7af8-4b75-b3e8-ec247d10f980 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/c475829b-c46b-4320-984b-1c5368564cf8" status: 200 len: 1221 microversion: 2.1 time: 0.564439 Sep 01 08:16:12.661063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 19/29] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:12 2022] GET /compute/v2.1/servers/c475829b-c46b-4320-984b-1c5368564cf8 => generated 1221 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:12.714570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f6d9ed11-9207-4e56-89ae-5bcda3f4beaf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:12.719761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f6d9ed11-9207-4e56-89ae-5bcda3f4beaf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:12.745908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e96173e8-0ce9-4e6f-a2b1-ba25c7d5d209 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.027297 Sep 01 08:16:12.747177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 11/30] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:16:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:16:12.891189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f6d9ed11-9207-4e56-89ae-5bcda3f4beaf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:12.904858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f6d9ed11-9207-4e56-89ae-5bcda3f4beaf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1215 microversion: 2.1 time: 0.241287 Sep 01 08:16:12.906439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 20/31] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:12 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:13.740188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1022436307", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:16:13.919702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] validate_networks() for [('b2233808-8a34-44fc-b13b-29054ed6cb17', None, None, None, None, None)] {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:16:15.006902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8d448d5b-3423-4a9e-afa9-739bcfe4a4fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Action: 'create', calling method: .version_select at 0x7f2ac01268b0>, body: {"keypair": {"name": "tempest-keypair-1734933604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbC7VaJ21rrYNhaztlRXIwBjr7rdwMeOnYw86VxyBbCMTRif4+Kz5iW3jA1l1SeIlvhxOlPSP/pjlHrhNFsoIiieq4OdapRh1a0LiRLTd9wQowYS1uMy12Y7BR/Ov1eXQ=="}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:16:15.091459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-8d448d5b-3423-4a9e-afa9-739bcfe4a4fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for project 631e2e8467654c0ea799bf50fed7afad. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:16:15.116021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-8d448d5b-3423-4a9e-afa9-739bcfe4a4fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for user 7559a0b8d46b4524b40f68b992f6cfe9 and project 631e2e8467654c0ea799bf50fed7afad. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:16:15.213040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8d448d5b-3423-4a9e-afa9-739bcfe4a4fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.763337 Sep 01 08:16:15.213684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 12/32] 10.222.0.43 () {62 vars in 1200 bytes} [Thu Sep 1 08:16:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1766 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 08:16:15.240719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b1274f4-53a3-43c7-bb2f-0fa34e3d01a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:15.243750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b1274f4-53a3-43c7-bb2f-0fa34e3d01a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:15.448200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b1274f4-53a3-43c7-bb2f-0fa34e3d01a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:15.497376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b1274f4-53a3-43c7-bb2f-0fa34e3d01a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1215 microversion: 2.1 time: 0.271770 Sep 01 08:16:15.499690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 13/33] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:15 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:15.575952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:16:15.576432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:16:15.577055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:16:15.577459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:16:15.578209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:16:15.615442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:15.615950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:15.621774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:15.626898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:15.627688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:15.628364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:15.707239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Getting quotas for project 7d43ea736fc0496d841b2530242dfde6. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:16:15.729051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Getting quotas for user 854e77042ee14f7f806a33f9c9501bb0 and project 7d43ea736fc0496d841b2530242dfde6. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:16:15.780095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:16:15.788705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:16:16.024105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0262f7c3-720d-4ac3-966e-f83ceecea810 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.313282 Sep 01 08:16:16.036488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 21/34] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:16:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:16:16.046236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6685dd1a-acfe-4fc0-a26d-d6db4963d174 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:16.046236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6685dd1a-acfe-4fc0-a26d-d6db4963d174 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:16.544863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b51126c3-5d3d-4541-9afc-d82f564b459a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:16.545808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b51126c3-5d3d-4541-9afc-d82f564b459a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:16.563525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6685dd1a-acfe-4fc0-a26d-d6db4963d174 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:16.585966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6685dd1a-acfe-4fc0-a26d-d6db4963d174 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1222 microversion: 2.1 time: 0.544979 Sep 01 08:16:16.596103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 14/35] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:16 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1222 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:16.929165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b51126c3-5d3d-4541-9afc-d82f564b459a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:16.937853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b51126c3-5d3d-4541-9afc-d82f564b459a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1215 microversion: 2.1 time: 0.398652 Sep 01 08:16:16.944753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 22/36] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:16 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1215 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:17.633974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:17.636216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:17.653825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:17.654845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:17.656313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:17.658212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:17.660922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:17.663091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:17.968232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:17.971936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:17.982245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:17.982828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:17.983061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:17.983279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:17.984007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:17.990145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:17.991944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:18.005277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9e1879dd-564a-43bb-ade1-42d2bf7d3262 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.377654 Sep 01 08:16:18.006746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 15/37] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:17 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:18.271786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:18.294698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d5ba0887-4af7-403d-9075-0fe72ec80a81 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.332326 Sep 01 08:16:18.295617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 23/38] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:17 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:18.992492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1965193487", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d30f2003-569b-461f-8960-16f50bc6e4df"}], "security_groups": [{"name": "tempest-securitygroup--1552085343"}], "key_name": "tempest-keypair-1619341742", "user_data": "}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:16:19.028394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:19.029999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:19.041142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:19.045193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:19.046238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:19.048944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:19.049732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:19.052480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:19.184775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] validate_networks() for [('d30f2003-569b-461f-8960-16f50bc6e4df', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:16:19.209860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:19.218628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8173fb7a-bba1-4891-90fd-fbbe6b499747 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.195051 Sep 01 08:16:19.222698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 24/39] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:19 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:19.315947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:19.317149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:19.335374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:19.336370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:19.337951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:19.339846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:19.340772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:19.341427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:19.812501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:19.837955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9fc7ea08-75c8-4269-83ec-7a94ac2f3ce3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.526287 Sep 01 08:16:19.853749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 25/40] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:19 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:20.149914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1547646544", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65699cbd-f387-4c8e-aac1-9e9e4b156099"}], "security_groups": [{"name": "tempest-securitygroup--788485743"}], "key_name": "tempest-keypair-1734933604", "user_data": "}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:16:20.359078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:16:20.360568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:16:20.361248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:16:20.361824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:16:20.362562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:16:20.384559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:20.386073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:20.386603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:20.387751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:20.390115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:20.390728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:20.428829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:16:20.435054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for user eaf3d36d40d442019e09a3e4c32b8330 and project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:16:20.455890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:16:20.459567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:16:20.484151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] validate_networks() for [('65699cbd-f387-4c8e-aac1-9e9e4b156099', None, None, None, None, None)] {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:16:20.575694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2325daa6-3483-4460-9d2f-3284d7a07328 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.589085 Sep 01 08:16:20.578700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 16/41] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:16:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:16:20.606999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:20.614868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:20.667904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:20.668874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:20.670872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:20.675748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:20.677138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:20.679413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:20.876507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:20.890900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-719be534-48f0-447d-9670-3db666619e4d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.308952 Sep 01 08:16:20.892254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 17/42] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:20 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:20.902398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c599c47c-cef8-451b-9878-d943593a03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:20.903288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c599c47c-cef8-451b-9878-d943593a03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:21.133744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c599c47c-cef8-451b-9878-d943593a03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:21.157707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c599c47c-cef8-451b-9878-d943593a03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1238 microversion: 2.1 time: 0.263688 Sep 01 08:16:21.174761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 18/43] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:20 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1238 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:21.192836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:21.199852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:21.254010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:21.255639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:21.256444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:21.257756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:21.271677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:21.272512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:21.485265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:21.526965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-16dd266c-c5da-468b-94c9-0a0ad3272334 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.346873 Sep 01 08:16:21.549340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 19/44] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:21 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:21.669791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:16:21.670581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:16:21.672708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:16:21.673376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:16:21.674723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:16:21.693127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:21.693639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:21.694284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:21.699126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:21.699625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:21.700072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:21.745438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for project 631e2e8467654c0ea799bf50fed7afad. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:16:21.756171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for user 7559a0b8d46b4524b40f68b992f6cfe9 and project 631e2e8467654c0ea799bf50fed7afad. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:16:21.773477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:16:21.776284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:16:21.881961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-952f559f-10df-4975-a906-d304d21d5250 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.736317 Sep 01 08:16:21.883689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 26/45] 10.222.0.43 () {62 vars in 1188 bytes} [Thu Sep 1 08:16:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 08:16:21.905432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dafb6039-1397-4ca8-b989-54177e660e3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:21.907093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dafb6039-1397-4ca8-b989-54177e660e3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:21.927532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:21.928160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:21.937984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:21.938592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:21.939042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:21.939664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:21.940134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:21.948376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:22.037900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dafb6039-1397-4ca8-b989-54177e660e3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:22.053978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dafb6039-1397-4ca8-b989-54177e660e3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:22.061596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dafb6039-1397-4ca8-b989-54177e660e3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:22.063099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dafb6039-1397-4ca8-b989-54177e660e3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1282 microversion: 2.20 time: 0.172728 Sep 01 08:16:22.080130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 20/46] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:21 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:22.163314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:22.174689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-545e7967-19ce-4433-aa8a-0dda6ec26926 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.251321 Sep 01 08:16:22.176845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 27/47] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:21 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:22.198582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:22.199469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:22.206250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:22.206799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:22.208350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:22.209452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:22.210402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:22.211153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:22.302390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:22.313659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6976aa7e-15ba-4338-8cfe-df19d2894510 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.120049 Sep 01 08:16:22.314533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 21/48] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:22 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:22.572968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:22.580703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:22.621462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:22.622417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:22.623279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:22.624501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:22.625299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:22.626013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:22.820354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:22.831925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6eb005c1-7f95-4143-aa6e-763382fee360 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.267967 Sep 01 08:16:22.836816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 28/49] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:22 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:23.094250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cd5adf9b-8e50-4ca7-8137-488e82de1dfc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:23.095094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cd5adf9b-8e50-4ca7-8137-488e82de1dfc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:23.202501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:23.203152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:23.248200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:23.248200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:23.248200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:23.248200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:23.248546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:23.248546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:23.274785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd5adf9b-8e50-4ca7-8137-488e82de1dfc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:23.287409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd5adf9b-8e50-4ca7-8137-488e82de1dfc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:23.290505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd5adf9b-8e50-4ca7-8137-488e82de1dfc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:23.290505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cd5adf9b-8e50-4ca7-8137-488e82de1dfc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1282 microversion: 2.20 time: 0.200157 Sep 01 08:16:23.302175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 22/50] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:23 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:23.336620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:23.337296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:23.349766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:23.350652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:23.351286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:23.352188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:23.352660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:23.353174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:23.435850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:23.445941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5c8d6d24-c5aa-4bcb-bf5e-e47b5f8a9a91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.248138 Sep 01 08:16:23.459228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 29/51] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:23 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:23.526418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:23.546687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-18f113d7-40f7-4722-9f8d-dc3321d05027 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.212974 Sep 01 08:16:23.548540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 23/52] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:23 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:23.878572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:23.882244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:23.896694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:23.899195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:23.899931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:23.903992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:23.904710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:23.905273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:23.998802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:24.010074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09191962-22cf-4565-b597-f14137a73d24 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.143604 Sep 01 08:16:24.010987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 30/53] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:23 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:24.327163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:24.327779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:24.346828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:24.350551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:24.351661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:24.353163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:24.354225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:24.355260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:24.469411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:24.470033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:24.482716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:24.485978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:24.486647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:24.487502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:24.488037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:24.488797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:24.492276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:24.497524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:24.502031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:24.503424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a733943-9751-4783-8104-f967291a9029 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.181463 Sep 01 08:16:24.523122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 24/54] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:24 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:24.584705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:24.585601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:24.593940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:24.601664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:24.603326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:24.608106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:24.608791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:24.609389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:24.609754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:24.621206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe0e30c5-a16d-452d-a7c6-3bcdf9e85f2f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.157073 Sep 01 08:16:24.622373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 31/55] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:24 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:24.740142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:24.750520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2524ae86-68e0-4aba-8580-660517b8ada3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.170206 Sep 01 08:16:24.766594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 25/56] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:24 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:25.034905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:25.035988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:25.058968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.060133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.061215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.063088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.066052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.068917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.234416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:25.253400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a96dabc-7919-4203-b8df-0a6b4ba48ead tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.223848 Sep 01 08:16:25.270457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 32/57] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:25 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:25.539881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:25.541090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:25.554196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.554835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.555472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.556631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.557645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.558392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.641305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:25.647725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:25.648224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:25.652358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:25.654091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:25.659177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-40317f2a-76a1-443c-86cf-32ac7b68e8f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.128034 Sep 01 08:16:25.659808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 26/58] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:25 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:25.661671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.662533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.663396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.664560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.665240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.666000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.774616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:25.775238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:25.776710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:25.786732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.788633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.789104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.790189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:25.791166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:25.791914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:25.811527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0d5de8ed-2d97-4584-8cde-bbe2a53beefb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.167208 Sep 01 08:16:25.812726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 33/59] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:25 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:25.885907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:25.900455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6de60be0-7c3e-4ebd-9a32-50fe305c8461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.130605 Sep 01 08:16:25.901517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 27/60] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:25 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:26.291626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:26.293075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:26.311950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.312682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.314892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.317928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.318472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.318923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.543772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:26.557412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d4d2f63-5822-45c9-aa60-7cea0fe09149 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.267990 Sep 01 08:16:26.557412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 34/61] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:26 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:26.695150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:26.696694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:26.708433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:26.710642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.711365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.712142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.713534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.714196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.715945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.823096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:26.842721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:26.843753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:26.844348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:26.844760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:26.845496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0015118-e70f-48a3-a95e-3514a2730cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.164039 Sep 01 08:16:26.850585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 28/62] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:26 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:26.853869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.854635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.855699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.856745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.857611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.858174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.922407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:26.923430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:26.930809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.931763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.932416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.933381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:26.934047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:26.934671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:26.968562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:26.984199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-76ffa7d8-888c-41f0-86c5-9c1cec29cb5d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.145531 Sep 01 08:16:27.008428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 35/63] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:26 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:27.037565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:27.047437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0602f6dc-867a-44f7-bcbb-7f0ded25e4f1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.128899 Sep 01 08:16:27.056803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 29/64] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:26 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:27.581065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:27.583598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:27.593330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:27.603320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:27.610178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:27.615550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:27.617111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:27.617944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:27.618721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:27.721011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:27.732041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cb114c66-1d54-4725-b6bb-4d79f0a641d6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.158048 Sep 01 08:16:27.732631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 36/65] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:27 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:27.873911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:27.874583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:27.884666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:27.885159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:27.885590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:27.886329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:27.886897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:27.887193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:27.964687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:27.974915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:27.976614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:27.977946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-541a7413-84d0-4562-8dae-a3800abc78e2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.108954 Sep 01 08:16:27.978899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 30/66] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:27 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:28.020543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:28.021415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:28.028520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:28.029425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:28.031328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:28.032449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:28.033208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:28.033892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:28.070743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:28.071732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:28.102289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:28.102804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:28.107683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:28.109367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:28.112541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:28.114949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:28.118806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:28.131704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fb0a0fdc-238e-4bd6-876d-2a03985ccc6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.116681 Sep 01 08:16:28.139862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 37/67] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:28 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:28.277391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:28.288071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb5a93d7-c4e1-47ab-82df-96b32b7d06a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.223466 Sep 01 08:16:28.289104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 31/68] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:28 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:28.774765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:28.776974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:28.788911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:28.789784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:28.790747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:28.791887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:28.792706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:28.793471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:28.917157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:28.928681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5d0e03e-d6e8-45f8-b34f-a97fb650fb87 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.161012 Sep 01 08:16:28.932530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 38/69] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:28 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:29.003118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:29.004750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:29.016180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.017691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.018342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:29.019333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.020117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.025057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:29.156582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:29.157146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:29.173671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:29.183576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:29.185564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.186321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.188302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:29.189730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:29.190721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.191464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.193177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-16f5bbd5-db8c-4d84-b757-67dbd5632304 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.195921 Sep 01 08:16:29.193882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:29.212187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 32/70] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:28 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:29.250121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:29.324422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:29.325690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:29.326368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:29.336859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-688e045e-e659-47e8-bdb7-9ea82c447127 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.184738 Sep 01 08:16:29.338103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 39/71] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:29 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:29.339598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.340142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.340621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:29.341421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.341910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.342367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:29.449290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:29.460336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f5b26d6e-7dc5-443a-a586-0c170e79a997 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.138886 Sep 01 08:16:29.461377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 33/72] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:29 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:29.967195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:29.967884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:29.975958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.976434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.976875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:29.977616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:29.978244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:29.978725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:30.063017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:30.073603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9ca11e70-04bd-42ac-b8e1-0be46ab4b665 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.111814 Sep 01 08:16:30.074416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 40/73] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:29 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:30.225204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:30.225747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:30.233271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:30.233965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:30.234475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:30.235195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:30.235588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:30.236004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:30.325052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:30.328571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.335939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:30.337616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:30.338794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3224d04-bccd-4a92-b325-0b630844e718 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.119649 Sep 01 08:16:30.339710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 34/74] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:30 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:30.362347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:30.364191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:30.371520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:30.372400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:30.373115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:30.378637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:30.380090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:30.380949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:30.478621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:30.488833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:30.490363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:30.492018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3a45e21e-03f6-4211-b3ed-bf0c8ebc4cd8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.133850 Sep 01 08:16:30.501666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 41/75] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:30 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:30.514126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=4 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.516240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:30.517065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:30.517792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:30.519199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:30.520444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:30.521323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:30.605909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:30.633892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f0c3c420-382c-4ef3-8619-ba1c61e6e329 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.143733 Sep 01 08:16:30.638911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 35/76] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:30 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:31.099826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:31.115724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:31.129286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.132855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.133709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.140445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.141548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.142594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.306959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:31.317512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d81c9b38-464a-4317-9453-1168207c8b4d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.225999 Sep 01 08:16:31.318238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 42/77] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:31 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:31.368357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:31.370623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:31.382887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.384234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.385318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.387023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.388187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.389255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.517225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:31.517885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:31.526464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.527598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.527727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:31.528395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.529550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.530298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.531104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.559156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:31.562742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:31.566992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-915f2c60-f6a1-4b18-abac-1052ac03cf9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.204958 Sep 01 08:16:31.568963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 36/78] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:31 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:16:31.669368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:31.670250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:31.681067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.682364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.683158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.685139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:31.686760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:31.688254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:31.732631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=6 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:31.767897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=24 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:31.787961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:31.803438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-309eb471-b669-45ba-9d00-5fd19c9c4ce8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.290103 Sep 01 08:16:31.804473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 43/79] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:31 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:31.885885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:31.898281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fe911ad9-0069-43f4-9e22-236fd957335e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.236622 Sep 01 08:16:31.920220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 37/80] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:31 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:32.342574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:32.342574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:32.353413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.353913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.354377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.355307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.355776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.356200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.432833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:32.445946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3652cfe-1643-45f9-a4b7-07146fbf45af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.109730 Sep 01 08:16:32.446132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 44/81] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:32 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:32.600369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:32.601672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:32.614619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.615558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.616706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.617866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.618652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.619353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.700770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:32.712111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:32.713691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:32.715328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-937aa3c8-b24d-40c5-86b7-46e90a6371fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.126048 Sep 01 08:16:32.715973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 38/82] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:32 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:32.825316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:32.825931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:32.834495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.835314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.835952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.836667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.837364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.837740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.923001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:32.924227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:32.936860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.937892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.938782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.940118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:32.941531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:32.942403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:32.942575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:32.959551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5ebc51e-5b77-4fd3-91b1-ac72e348bd79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.138087 Sep 01 08:16:32.960325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 45/83] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:32 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:33.050951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:33.064260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-539ce60e-8abf-49f9-9cc7-91f3e9a16b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.146512 Sep 01 08:16:33.065314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 39/84] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:32 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:33.467170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:33.467993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:33.477485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:33.477879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:33.478367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:33.479182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:33.480314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:33.480811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:33.550176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:33.561867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9249bb2b-983c-4ec5-a37c-0e3855e2608b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.098945 Sep 01 08:16:33.562530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 46/85] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:33 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:33.745056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:33.745675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:33.747684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=30 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:33.753935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:33.754445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:33.754880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:33.755590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:33.756024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:33.756598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:33.830321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:33.844987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:33.849139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:33.851360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1cd179ac-e1b4-40ac-bb32-85c4817bf435 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.110643 Sep 01 08:16:33.852324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 40/86] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:33 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:33.983102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:33.984276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:33.991620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:33.992113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:33.992539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:33.993238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:33.993687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:33.994453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:34.061534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:34.070300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-efd721f9-b0a9-4a9d-bd79-0ff32dcf8226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.092960 Sep 01 08:16:34.070880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 47/87] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:33 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:34.088153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:34.089068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:34.095566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:34.096057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:34.096498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:34.098100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:34.098767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:34.099201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:34.171606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:34.186712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b0aea483-9116-4c59-915e-89044adda540 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.103048 Sep 01 08:16:34.187952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 41/88] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:34 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:34.583975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:34.584618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:34.591484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:34.591949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:34.592508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:34.593350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:34.593864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:34.594408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:34.663666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:34.677099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-29b9d0de-9699-4b13-bb03-65e483f5e9dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.097554 Sep 01 08:16:34.678326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 48/89] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:34 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:34.876623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:34.877880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:34.885840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:34.886360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:34.887123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:34.887724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:34.888351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:34.888867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:34.991415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:35.009322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:35.014921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:35.016948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fbf118cd-3895-4012-ae7e-81083161df9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.144299 Sep 01 08:16:35.043960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 42/90] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:34 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:35.092152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:35.092870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:35.100153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:35.100711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:35.101157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:35.102073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:35.103002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:35.103497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:35.215469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:35.216101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:35.226895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:35.227709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:35.235235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:35.235461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:35.237175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:35.237734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:35.239015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:35.252588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c2512a2-a0bb-4ab7-a719-ce6981e193aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.164516 Sep 01 08:16:35.254329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 49/91] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:35 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:35.345359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:35.361507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fcac92f4-aa4a-4091-af18-c9f3f95d0365 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.154331 Sep 01 08:16:35.363025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 43/92] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:35 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:35.703645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:35.705696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:35.718222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:35.718542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:35.719505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:35.720547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:35.721202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:35.721682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:35.795248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:35.805004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fa2c3af3-9d9b-45ae-b719-b1b2558228ff tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.109198 Sep 01 08:16:35.805836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 50/93] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:35 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:36.057206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:36.058012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:36.065345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.065345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.065705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.066709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.067454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.068049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.136239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:36.145928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:36.147486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:36.148928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-932af51e-99fd-4f7f-abe8-f8fca6d60a16 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.096128 Sep 01 08:16:36.149583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 44/94] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:36 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:16:36.295295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:36.295901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:36.302237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.302671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.303105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.303808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.304260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.304683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.375695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:36.387713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:36.388280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:36.396127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.397194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6e3d2808-fdc5-4b66-b5b8-41a78c91aa83 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.105511 Sep 01 08:16:36.398622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.399856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.405790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 51/95] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:36 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:36.408663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.411690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.413305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.537140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:36.551877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec759c9e-c639-4eee-a44d-e9f7515f5974 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.167892 Sep 01 08:16:36.553049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 45/96] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:36 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:36.836378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:36.837603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:36.849885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.850806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.851587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.852816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:36.853923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:36.854911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:36.952213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:36.970716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85c56fcf-a92f-4b65-953e-eb7b6b8314c1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.145518 Sep 01 08:16:36.973132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 52/97] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:36 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:37.178036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:37.180508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:37.193183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:37.194314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:37.194941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:37.196356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:37.197164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:37.198093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:37.312188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:37.323731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:37.326085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:37.327887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f34bcff-cf32-41e9-9783-930c0babb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.157394 Sep 01 08:16:37.342700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 46/98] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:37 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:37.424476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:37.426525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:37.437499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:37.437804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:37.438251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:37.439579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:37.440034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:37.441418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:37.558672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:37.573809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38a03b62-ee46-4d33-9d59-a83c37939b4f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.158101 Sep 01 08:16:37.575099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 53/99] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:37 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:37.577943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:37.578634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:37.606854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:37.611275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:37.612052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:37.613781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:37.614718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:37.615341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:37.724351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:37.734469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-168d3676-1647-47b2-894c-d0e01a4adf54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.162632 Sep 01 08:16:37.746889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 47/100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:37 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:37.994599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:37.995862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:38.003642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.004309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.004909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.006285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.007090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.007778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.134375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:38.147715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c5c32bf-6f1a-495d-9edc-634ef186ed7d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.156727 Sep 01 08:16:38.156225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 54/101] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:37 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:38.354024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:38.354670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:38.361014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.361513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.361947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.362803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.363578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.364009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.438492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:38.445647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:38.447429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:38.448617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d0a4a678-a328-4461-bbd9-adf2d77c9595 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.098553 Sep 01 08:16:38.449561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 48/102] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:38 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:38.608395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:38.610537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:38.621920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.622598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.623406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.625071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.625938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.626826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.714519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:38.724797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b2f45e9-77db-40a7-b3a3-826bcad3361d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.123279 Sep 01 08:16:38.725781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 55/103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:38 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:38.758547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:38.759301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:38.766396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.767198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.767821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.768734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:38.769879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:38.770452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:38.885677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:38.897071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b5ddbba-3b3c-4e26-bd34-0944f060589f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.142127 Sep 01 08:16:38.899150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 49/104] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:38 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:39.176274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:39.177399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:39.190687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.192856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.195128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.196600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.197418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.198243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.229067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:39.281856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:39.296507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-732e023b-0e58-4c9a-9181-d11a5c475199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.128903 Sep 01 08:16:39.297434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 56/105] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:39 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:39.494036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:39.494762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:39.504596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.505654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.506401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.507242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.507794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.508731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.638368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:39.657746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:39.662977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:39.665375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-88372a66-d8cd-4dfa-91ea-f94248f80e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.175018 Sep 01 08:16:39.671986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 50/106] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:39 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:39.761680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:39.762655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:39.773197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.773814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.774431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.775190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.775807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.776394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.891955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:39.904499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb79957b-dc80-43d0-8374-0929bc054f1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.148977 Sep 01 08:16:39.910332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 57/107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:39 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:39.945858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:39.947954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:39.962026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.962794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.963453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.964491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:39.965144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:39.965769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:39.991439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:40.109316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:40.141703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e509a8af-dec0-414e-91a0-d0425e1cbfba tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.211783 Sep 01 08:16:40.166169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 51/108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:39 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:40.338849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:40.340011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:40.351394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:40.352378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:40.353329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:40.354594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:40.355475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:40.356264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:40.527100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:40.541745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-efeac33f-e0de-4f02-b262-242432c02274 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.205965 Sep 01 08:16:40.561044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 58/109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:40 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:40.699343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:40.700484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:40.708643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:40.709719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:40.711035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:40.712041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:40.713905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:40.715288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:40.795145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:40.809080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:40.810734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:40.811875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-180b7860-d7f7-4e58-87d8-fd527d71eae5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.116852 Sep 01 08:16:40.812803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 52/110] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:40 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:16:40.926192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:40.926901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:40.933669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:40.934173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:40.934767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:40.935579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:40.936258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:40.936893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:41.008851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:41.018155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a083d1d3-1a4a-4bfe-8c13-76c4b7eb73ad tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.096737 Sep 01 08:16:41.018796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 59/111] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:40 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:41.183670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:41.184897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:41.195003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:41.196081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:41.196885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:41.199230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:41.200063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:41.201005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:41.328660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:41.355164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2796194e-e4a5-42fc-a480-d3f778976e6a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.177529 Sep 01 08:16:41.356765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 53/112] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:41 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:41.560524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:41.561343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:41.571171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:41.572261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:41.573531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:41.574743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:41.576201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:41.577045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:41.732308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:41.748368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc833358-a488-4470-abf1-0d15c744bec7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.192877 Sep 01 08:16:41.763701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 60/113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:41 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:41.848636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:41.849591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:41.883203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:41.883203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:41.883924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:41.887393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:41.891230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:41.892253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:42.021580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:42.042042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:42.042976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:42.046459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:42.052931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:42.053739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:42.055138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:42.056260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:42.056385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:42.057050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:42.057656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:42.063181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-833e8b44-8621-4ef3-ae61-d99b31d926fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.222055 Sep 01 08:16:42.068722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 54/114] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:41 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:42.159488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:42.169105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6bd3bc32-dd68-4b30-afd9-9625eae8825b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.131505 Sep 01 08:16:42.169911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 61/115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:42 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:42.379682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:42.379682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:42.390106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:42.390637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:42.393959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:42.395162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:42.395649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:42.396084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:42.484728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:42.496627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c047629f-f660-47b1-b1cc-7d980ab4a9e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.122400 Sep 01 08:16:42.497919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 55/116] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:42 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:42.789359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:42.790113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:42.796480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:42.796960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:42.797391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:42.798081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:42.798575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:42.798987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:42.902500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:42.921830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1ba81c5b-99b4-4596-a6cd-fa573d973684 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.135493 Sep 01 08:16:42.926350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 62/117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:42 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:43.090852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:43.091632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:43.101986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.102870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.103312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:43.104024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.104476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.105214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:43.205914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:43.210232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:43.225104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:43.226166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.226872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.228831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:43.230400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.231660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.232650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:43.238733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:43.241146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:43.245662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-55deef8b-2985-4717-a603-d8fda10688e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.157410 Sep 01 08:16:43.247890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 56/118] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:43 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:43.396093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:43.416397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-733dfe5f-bed1-4874-a267-978078d4ff9f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.226739 Sep 01 08:16:43.418602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 63/119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:43 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:43.525467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:43.526167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:43.534464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.535709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.538004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:43.539031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.539616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.540663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:43.713678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:43.738135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f58da76c-d358-4e82-af72-749181fec8ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.221886 Sep 01 08:16:43.751075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 57/120] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:43 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:43.943291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:43.943900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:43.950409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.950928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.951363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:43.952191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:43.952648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:43.953158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:44.030939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:44.042162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e0daf6c5-b405-4e9c-aae0-0c05e415b7cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.102559 Sep 01 08:16:44.054285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 64/121] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:43 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:44.299021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:44.299754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:44.307154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:44.308563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:44.308999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:44.309940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:44.311227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:44.312194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:44.381763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:44.392372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:44.394347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:44.395802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-95895302-9e62-4346-92d5-cc8bc13af33d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.101127 Sep 01 08:16:44.396714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 58/122] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:44 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:44.454171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:44.455134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:44.464260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:44.465091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:44.465803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:44.467258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:44.468019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:44.468762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:44.546879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:44.559908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-888df678-5f7e-4a87-bacd-81af0c97b4cc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.112198 Sep 01 08:16:44.561034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 65/123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:44 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:44.764020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:44.764768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:44.780048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:44.782821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:44.783427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:44.784929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:44.785560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:44.786150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:44.908286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:44.917934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9d32c574-9dc7-41db-a72b-900d6eb1a33d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.158065 Sep 01 08:16:44.918556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 59/124] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:44 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:45.065350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:45.066778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:45.074230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.074756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.075747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:45.076839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.077602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.078385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:45.165004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:45.177212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02f391e6-19c9-4331-922b-a66c1b536fd2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.115321 Sep 01 08:16:45.178750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 66/125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:45 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:45.419868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:45.420472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:45.426588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.427265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.427714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:45.428381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.428823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.429237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:45.500835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:45.511606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:45.513023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:45.514359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f361679-690b-459c-afda-037ae320b9c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.098326 Sep 01 08:16:45.515014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 60/126] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:45 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:45.581194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:45.582466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:45.588751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.589352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.589652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:45.590388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.590841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.591261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:45.659832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:45.669177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea138ee4-7464-4519-b3f4-d6397743b34f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.091655 Sep 01 08:16:45.670219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 67/127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:45 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:45.960590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:45.961498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:45.967763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.968245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.968708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:45.969405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:45.969850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:45.972570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:46.038296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:46.050082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93ad733f-913f-4f2f-b2f0-e754efe779da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.093845 Sep 01 08:16:46.050852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 61/128] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:45 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:46.202796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:46.203822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:46.218182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:46.219290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:46.220279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:46.222455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:46.223087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:46.223938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:46.360344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:46.373849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8117aacf-151b-490f-899b-554599d40be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.175550 Sep 01 08:16:46.374948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 68/129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:46 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:46.538531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:46.539680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:46.548316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:46.549017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:46.549728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:46.551302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:46.551914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:46.552460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:46.643469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:46.653798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:46.655490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:46.656762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-23656a2d-13dc-484c-8659-e65f481951e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.123028 Sep 01 08:16:46.682461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 62/130] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:46 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:46.696319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:46.698063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:46.707189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:46.708957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:46.709791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:46.711035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:46.711663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:46.712376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:46.917402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:46.930615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6d2a44e-d1e1-4086-8c49-e9b85841836f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.241170 Sep 01 08:16:46.931908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 69/131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:46 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:47.071268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:47.071898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:47.078173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.078696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.079188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:47.079903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.080358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.080777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:47.180710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:47.193804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c8335d98-2aa8-4ec0-b6ca-92672ebd2a9e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.126459 Sep 01 08:16:47.194540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 63/132] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:47 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:47.400118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:47.400897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:47.409338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.409998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.410616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:47.411448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.412060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.412734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:47.498812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:47.509408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ba883a1-461b-4591-89a9-cf24b2ba1eda tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.116035 Sep 01 08:16:47.510236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 70/133] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:47 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:47.682666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:47.683604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:47.691442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.692145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.692772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:47.693591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.694132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.694680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:47.773546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:47.793530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:47.795390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:47.796667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1eedce2e-ce5b-4d86-914f-989366463c8f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.118327 Sep 01 08:16:47.797421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 64/134] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:47 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:47.954558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:47.954961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:47.961925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.962382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.962975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:47.963702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:47.964106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:47.964525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:48.085285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:48.094120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38a60385-c964-4024-ba21-67663703c1f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.143966 Sep 01 08:16:48.095072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 71/135] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:47 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:48.223495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:48.224459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:48.235536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:48.236533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:48.237986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:48.239416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:48.240256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:48.241038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:48.327298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:48.338328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5627d816-1286-4a95-94dd-f16794fad396 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.122496 Sep 01 08:16:48.351565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 65/136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:48 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:48.531312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:48.531960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:48.540185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:48.541140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:48.541867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:48.543122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:48.543647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:48.544342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:48.653867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:48.657681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:48.663120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c54f02c-bc50-4921-9344-c2ec667999c2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.135756 Sep 01 08:16:48.663737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 72/137] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:48 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:48.826773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:48.827711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:48.837176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:48.837886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:48.838588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:48.839537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:48.839975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:48.840572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:48.962021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:48.974533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:48.977060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:48.979475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9c609784-ae34-403d-a7df-25d93d134a34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.157723 Sep 01 08:16:48.980309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 66/138] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:48 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:16:49.121179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:49.124237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:49.151185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:49.152053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:49.152805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:49.154245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:49.154876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:49.155799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:49.274347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:49.296767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca46fe6f-5de4-4178-bc04-40fdbb089de1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.185029 Sep 01 08:16:49.297389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 73/139] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:49 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:49.367987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:49.369167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:49.393129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:49.394035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:49.411626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:49.411626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:49.426934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:49.427874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:49.543010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:49.559856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4ffbb743-459e-423c-9b20-bf6dbf981779 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.198838 Sep 01 08:16:49.561217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 67/140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:49 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:49.698330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:49.699445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:49.717912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:49.718917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:49.719719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:49.730557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:49.734049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:49.734883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:49.862505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:49.875728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9256df74-2cbd-44c1-82fe-a4da594c48a0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.190356 Sep 01 08:16:49.890297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 74/141] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:49 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:50.012658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:50.014117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:50.025023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.025840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.026542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:50.028098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.028913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.029689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:50.037031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:50.145092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:50.162496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:50.164938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:50.166483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-99c0d301-b05c-4dcf-92c0-0c03ee9761fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.166050 Sep 01 08:16:50.182737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 68/142] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:49 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:50.318164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:50.318807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:50.326023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.327075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.327075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:50.327685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.328171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.332440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:50.469696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:50.489953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db6d4cc7-5216-4c61-8e71-9b0f9e543df3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.175530 Sep 01 08:16:50.490628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 75/143] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:50 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:50.604920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:50.606023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:50.626517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.627007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.627619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:50.629641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.640157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.647390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:50.817049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:50.828757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7dc4ae08-de65-40e5-a83b-26f70f171753 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.229147 Sep 01 08:16:50.829349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 69/144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:50 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:50.915671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:50.916612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:50.942974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.943592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.944138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:50.945020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:50.945559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:50.946051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:51.111217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:51.125748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ad717dbf-f019-4abb-a18a-ff213bd6b03d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.218678 Sep 01 08:16:51.138299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 76/145] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:50 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:51.190348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:51.192080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:51.201715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:51.207032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:51.207590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:51.209895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:51.217041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:51.217582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:51.309935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:51.326350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:51.328425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:51.333409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-930b522c-8c19-4d03-8fe5-5d370077de3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.147783 Sep 01 08:16:51.350444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 70/146] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:51 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:51.513691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:51.514317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:51.521349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:51.522161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:51.522894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:51.523860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:51.524539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:51.525081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:51.619558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:51.654854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ba54b88e-5c36-4431-bd55-527fcb7cde03 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.145681 Sep 01 08:16:51.657814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 77/147] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:51 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:16:51.857349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:51.858169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:51.865647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:51.866388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:51.867005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:51.867854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:51.868660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:51.869339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:51.959452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:51.978745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-76886af7-18bf-470f-9ab3-db55fd589655 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.126171 Sep 01 08:16:51.992476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 71/148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:51 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:52.149727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:52.150981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:52.158195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:52.158711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:52.159707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:52.160597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:52.161197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:52.161794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:52.257127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:52.266135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-612c2390-1fff-4982-a0eb-864920847a1a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.120538 Sep 01 08:16:52.268293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 78/149] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:52 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:52.359441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:52.360046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:52.366686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:52.367554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:52.368338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:52.369268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:52.369993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:52.370457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:52.454580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:52.471004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:52.471004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:52.471004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e756219a-605f-48b0-a6ce-ba53151727be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.115180 Sep 01 08:16:52.471678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 72/150] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:52 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:52.684981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:52.685856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:52.692838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:52.693788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:52.694416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:52.695418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:52.696295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:52.697094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:52.775585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:52.789682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a6b5622b-1720-475c-9712-d360e924ac5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.107719 Sep 01 08:16:52.791820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 79/151] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:52 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:52.999141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:52.999762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:53.009485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.010324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.010782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.011854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.012228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.012675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.085065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:53.093772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-96c8eba9-4097-4e80-967b-cecbc8e9028d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.098530 Sep 01 08:16:53.108970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 73/152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:52 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:53.297237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:53.297237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:53.299215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.299919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.300538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.304833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.304833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.304833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.372390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:53.381273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9a8c99a3-c628-47fa-8aab-4f375da5fc9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.094714 Sep 01 08:16:53.381841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 80/153] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:53 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:53.494663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:53.495104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:53.503492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.504012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.504447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.505146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.505597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.506009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.617438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:53.632213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:53.634725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:53.636379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eda5be51-3290-4e7d-a971-0d56c0529aa7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.146141 Sep 01 08:16:53.637544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 74/154] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:53 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:53.816627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:53.817380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:53.823789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.824444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.825143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.826047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:53.826706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:53.827125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:53.905723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:53.914220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-46b19cd0-63c6-46ec-8ec6-1bf57aa06e20 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.103000 Sep 01 08:16:53.915835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 81/155] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:53 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:54.120812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:54.121424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:54.129638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.130121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.130584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:54.131295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.131730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.132152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:54.221980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:54.233307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8960deec-1ab2-419a-b838-421ff1dee0af tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.116674 Sep 01 08:16:54.234235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 75/156] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:54 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:54.403845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:54.404522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:54.414904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.415404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.416914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:54.419109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.420016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.420765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:54.540978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:54.554028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-795523f1-6e2e-4669-9120-fd5d8ce70ab1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.154106 Sep 01 08:16:54.555277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 82/157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:54 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:54.661755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:54.662401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:54.674036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.675435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.675881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:54.680092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.681030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.681460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:54.766968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:54.776550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:54.777983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:54.779209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1414a376-4550-4c56-8736-1c5a5623fb25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.122191 Sep 01 08:16:54.791682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 76/158] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:54 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:54.936723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:54.938796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:54.951856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.956440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.958452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:54.959875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:54.962705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:54.963565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:55.075004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:55.088909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-49299fd6-35ef-405a-a5bd-4dce46f9faef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.157569 Sep 01 08:16:55.097851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 83/159] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:54 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:55.256191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:55.257180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:55.263688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:55.264185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:55.264782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:55.266105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:55.267170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:55.267930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:55.341580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:55.350145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f151df9e-18af-4f5f-9627-f3be933e51c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.098484 Sep 01 08:16:55.351266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 77/160] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:55 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:55.583820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:55.585025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:55.594926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:55.595800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:55.596745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:55.597945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:55.598888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:55.600050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:55.709821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:55.723240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fed49496-20b4-4fde-8bf3-b4d05975e522 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.147005 Sep 01 08:16:55.724292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 84/161] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:55 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:55.805052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:55.806308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:55.808429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:55.814950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:55.816407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:55.817075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:55.818073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:55.818663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:55.819291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:55.898822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:55.912866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:55.915562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:55.917081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61f1a129-1db4-4b46-867a-83a96b1e50d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.116127 Sep 01 08:16:55.917658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 78/162] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:55 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:56.116392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:56.120249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:56.141696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.142348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.143135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:56.144243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.144622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.145032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:56.238583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:56.252328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b41cc564-7f7f-4ebf-a90e-5658cd733cba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.143966 Sep 01 08:16:56.262291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 85/163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:56 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:56.374615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:56.375735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:56.394572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.398141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.399745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:56.400794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.401622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.402754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:56.506046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:56.516668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d59d062-b1e3-4595-a4a0-714082e361e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.148517 Sep 01 08:16:56.526378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 79/164] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:56 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:56.750233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:56.751404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:56.755133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:56.769443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.769443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.769443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:56.769443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.769976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.770389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:56.844739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:56.856851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-32ea8762-ba53-4950-8fce-947c7139305f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.114693 Sep 01 08:16:56.857476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 86/165] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:56 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:56.944119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:56.944742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:56.955524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.957241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.958107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:56.960195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:56.960872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:56.961608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:57.083609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:57.092878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:57.094893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:57.096558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c6d788b9-0c46-4e03-87a1-b810365c004c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.159392 Sep 01 08:16:57.097722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 80/166] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:56 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:57.280300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:57.281089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:57.289746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:57.290302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:57.290971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:57.292076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:57.292944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:57.293528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:57.415964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:57.434476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4befdd5-48a6-4573-bab3-dc451513967d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.161933 Sep 01 08:16:57.446504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 87/167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:57 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:57.539636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:57.540719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:57.553050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:57.553966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:57.554674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:57.555589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:57.556219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:57.556837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:57.638471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:57.647782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-97fd0c37-9fc5-42ee-8351-5d9cf7a3d405 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.112321 Sep 01 08:16:57.648463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 81/168] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:57 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:57.877437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:57.879126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:57.885776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:57.886604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:57.886802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:57.887813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:57.888274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:57.888888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:57.967918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:57.977881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-29da44b4-77be-4b98-9ba0-48b5a6f8780b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.104290 Sep 01 08:16:57.979399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 88/169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:57 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:58.124501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:58.125599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:58.134764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:58.136148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:58.136821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:58.137767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:58.138539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:58.139239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:58.220991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:58.233620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:58.235305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:58.236662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ee83147-6091-4eb8-9474-9b66bea64f9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.119902 Sep 01 08:16:58.237951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 82/170] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:58 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:58.456868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:58.457666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:58.468392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:58.469187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:58.469850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:58.471019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:58.472606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:58.473436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:58.513458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.577043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:58.593577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9bb9a14e-8b62-43e2-a277-065dbd55b2bf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.141430 Sep 01 08:16:58.594677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 89/171] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:58 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:58.688798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:58.691371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:58.699393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:58.699865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:58.700602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:58.701705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:58.702396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:58.703414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:58.803965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:58.814478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ff8eb968-a24c-4138-b59c-220465668322 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.128603 Sep 01 08:16:58.815206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 83/172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:58 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:59.021803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:59.022539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:59.031421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.032157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.032857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:59.035503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.036337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.037056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:59.165194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:59.179685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2edac41c-513e-4291-9d1a-e064d76c2807 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.172421 Sep 01 08:16:59.182282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 90/173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:59 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:59.265592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:59.266927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:59.277669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.278554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.279212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:59.280318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.281102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.281880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:59.359310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:59.363072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:59.371012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:59.372943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:59.374451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a141732-d442-4af0-8760-3036b9dd9ced tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.113441 Sep 01 08:16:59.375437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 84/174] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:16:59 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:16:59.625777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:59.626749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:59.650439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.654429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.656731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:59.664309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.665140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.667879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:59.761906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:16:59.772530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b104600-db2b-4c9f-b3ac-1aa7adf45105 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.151186 Sep 01 08:16:59.773642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 91/175] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:59 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:16:59.853761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:16:59.854631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:16:59.863089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.864201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.865193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:16:59.866174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:16:59.866985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:16:59.867643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:00.039456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:00.059922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e4841439-b4ca-40ba-9811-606beb7cf3d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.225464 Sep 01 08:17:00.083546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 85/176] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:16:59 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:00.212461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:00.214235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:00.230589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:00.231095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:00.231708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:00.232816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:00.233564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:00.234194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:00.407796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:00.408498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:00.419299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:00.419456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:00.419895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:00.420789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:00.421343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:00.421803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:00.448708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:00.458947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-754e97eb-fae3-45f1-b8da-6d101aa55478 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.253926 Sep 01 08:17:00.459524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 92/177] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:00 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:00.513538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:00.523319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:00.525044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:00.526548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0bd37437-866b-4047-a024-3b123b8ba11f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.125879 Sep 01 08:17:00.527598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 86/178] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:00 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:00.812611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:00.814727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:00.822180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:00.823016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:00.823665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:00.824584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:00.825235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:00.826016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:00.908001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:00.915562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-735eb147-1206-43a3-a3c9-d55b7a17a974 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.110664 Sep 01 08:17:00.916508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 93/179] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:00 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:01.092777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:01.093651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:01.103482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.104516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.105493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:01.106599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.107262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.107883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:01.196293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:01.208604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-926f6ade-bf3c-4f13-9768-27aa05bb020c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.120376 Sep 01 08:17:01.209685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 87/180] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:01 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:01.485932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:01.488199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:01.495560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.496048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.496480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:01.497275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.497968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.498654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:01.554044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:01.555433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:01.561723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.562185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.562636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:01.563570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.564232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.564935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:01.575104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:01.586175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae783531-918c-4b75-9236-1e85740a69d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.107268 Sep 01 08:17:01.587666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 94/181] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:01 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:01.665281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:01.676426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:01.678127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:01.679289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9497591-97e7-4ff2-9d6d-0e53b1d19ab6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.131938 Sep 01 08:17:01.680078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 88/182] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:01 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:01.938782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:01.939481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:01.952125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.952614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.953129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:01.954091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:01.954685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:01.955090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:02.028807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:02.036561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25426e10-68a9-40e3-8e93-9ed0376e4500 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.102736 Sep 01 08:17:02.037157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 95/183] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:01 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:02.231500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:02.232253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:02.240150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:02.241100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:02.241932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:02.243127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:02.243892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:02.244451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:02.331279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:02.341557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-848e8e60-6d01-43ca-8fa2-b3e81c4e2857 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.113968 Sep 01 08:17:02.342534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 89/184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:02 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:02.613063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:02.614862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:02.624455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:02.625406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:02.626654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:02.628533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:02.629417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:02.630202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:02.708176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:02.709540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:02.725728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:02.726542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:02.727225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:02.728162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:02.729558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:02.730220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:02.733061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:02.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db64ff28-05de-4b3e-8beb-aa63a216a988 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.140636 Sep 01 08:17:02.759429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 96/185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:02 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:02.820751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:02.836469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:02.838088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:02.839612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28b54723-ac27-4f3e-a2b9-ec491dc52194 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.136283 Sep 01 08:17:02.847892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 90/186] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:02 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:03.057838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:03.058501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:03.069552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.070380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.071073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.082784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.085706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.086215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.243874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:03.252098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3910cac-78f8-43fc-b4ba-8302b75a64ce tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.198168 Sep 01 08:17:03.254067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 97/187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:03 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:03.367454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:03.369141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:03.381342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.382480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.383359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.384631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.385507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.386645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.490197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:03.503135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1c5dfb29-b88d-4740-a715-ed86a42df070 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.143258 Sep 01 08:17:03.504499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 91/188] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:03 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:03.773546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:03.774641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:03.782325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.782919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.784238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.785041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.786181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.786643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.874524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:03.875115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:03.881618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.882114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.882573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.883523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:03.884223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:03.884738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:03.901463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:03.914055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae285e60-1ece-42d4-8752-dbc0a584b2d9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.147625 Sep 01 08:17:03.932626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 98/189] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:03 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:03.974571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:03.984647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:03.986296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:03.987832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf3edd71-db44-462c-bdbb-6fc30aac2fd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.117322 Sep 01 08:17:03.990749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 92/190] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:03 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:04.275730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:04.278122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:04.286303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:04.287422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:04.287996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:04.289026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:04.289654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:04.290383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:04.376163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:04.387599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9d9c0c6d-c9d4-4978-b7ea-b48f82a03124 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.116758 Sep 01 08:17:04.388640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 99/191] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:04 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:04.529657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:04.530477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:04.538585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:04.539627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:04.540132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:04.540755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:04.541388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:04.541978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:04.617335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:04.631089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9e42a10-11d3-464f-b3df-2da4429adf95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.106730 Sep 01 08:17:04.641486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 93/192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:04 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:04.943973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:04.945904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:04.954352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:04.955135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:04.955658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:04.956613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:04.957556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:04.958351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:05.010035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:05.010806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:05.019603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:05.020631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:05.021225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:05.022889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:05.025570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:05.026349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:05.101204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:05.119866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-066ed73e-8589-4404-b26f-569e6ec0938c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.182455 Sep 01 08:17:05.120921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 100/193] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:04 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:05.150594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:05.164923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:05.166832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:05.172527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be16f5bf-379b-4749-998c-40ab9c42cc5b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.162085 Sep 01 08:17:05.172527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 94/194] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:05 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:05.410405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:05.411057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:05.417701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:05.418189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:05.418675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:05.419457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:05.419892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:05.420309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:05.485735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:05.493929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a2116d5-3a48-4bfb-a922-ca682a4826f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.088522 Sep 01 08:17:05.494527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 101/195] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:05 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:05.655097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:05.655816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:05.662969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:05.663393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:05.663827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:05.664516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:05.664966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:05.665392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:05.731392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:05.738880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e150a313-32c6-45ba-9cd6-b10215353126 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087584 Sep 01 08:17:05.739470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 95/196] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:05 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:06.142348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:06.143509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:06.152923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.153525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.154110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.154986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.155730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.156837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.198491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:06.207601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:06.219422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.220015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.220556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.223179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.223871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.224487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.250244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:06.270506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f92ca5f7-6b1e-4292-aeb1-4a1e63a99698 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.132044 Sep 01 08:17:06.271476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 102/197] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:06 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:06.355370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:06.366424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:06.373279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:06.376789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1509a40b-a90b-4063-be09-ae5e630a9b21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.183346 Sep 01 08:17:06.378808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 96/198] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:06 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:06.517798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:06.519080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:06.527289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.535365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.537172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.537943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.538452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.538884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.649123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:06.658034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6038b86d-ede9-41d1-9045-4f80197f4db8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.146083 Sep 01 08:17:06.658944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 103/199] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:06 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:06.760610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:06.761918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:06.771958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.772454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.772885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.773582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:06.774035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:06.774482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:06.882226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:06.891349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1f0302bd-1582-4548-8dfe-74422bfb0ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.135276 Sep 01 08:17:06.891921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 97/200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:06 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:07.292956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:07.293543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:07.302208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.302920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.303506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.305204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.305661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.306883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.391614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:07.400310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6168f5d7-9bf9-4f98-8320-dc7ca747ccc8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.111706 Sep 01 08:17:07.401359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 104/201] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:07 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:07.404740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:07.405498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:07.414976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.415852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.416320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.417176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.417788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.418555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.496253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:07.510417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:07.512512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:07.514014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8109f00c-7a8f-4b0f-ba41-1ae3690dbcba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.114912 Sep 01 08:17:07.528137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 98/202] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:07 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:07.682253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:07.682902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:07.689956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.691043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.691252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.692171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.692959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.693581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.809628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:07.822124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33c68817-91ab-4b2f-b8c2-36ddb9220600 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.144252 Sep 01 08:17:07.823052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 105/203] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:07 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:07.913641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:07.914614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:07.921177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.921770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.922294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.923214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:07.923850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:07.924467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:07.992954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:08.016251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e3c06fc6-ec1b-4bd8-a41d-86867e3e2374 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.107691 Sep 01 08:17:08.017594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 99/204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:07 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:08.423912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:08.425206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:08.431317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:08.431824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:08.432234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:08.433044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:08.433502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:08.434096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:08.438711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:08.520681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:08.531769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24efbb47-30af-4070-bc82-4255def2ef53 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.110354 Sep 01 08:17:08.531769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 106/205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:08 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:08.551490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:08.552517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:08.559910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:08.560514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:08.561108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:08.561911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:08.562612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:08.563129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:08.669573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:08.680253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:08.681873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:08.683146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-00b34006-2cd7-4f4b-bbcd-373ab9751e5c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.138083 Sep 01 08:17:08.684100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 100/206] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:08 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:08.848212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:08.849125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:08.855802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:08.856833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:08.857270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:08.857975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:08.858607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:08.859028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:08.955188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:08.963914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-45186bf2-5634-482e-ae16-4b131d0860f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.120237 Sep 01 08:17:08.964493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 107/207] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:08 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:09.055005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:09.055620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:09.061884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.063035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.063657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:09.064560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.065202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.065636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:09.087235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:09.137623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:09.146015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c850493-696f-4abe-9d5e-377ed4fba9e1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094759 Sep 01 08:17:09.146626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 101/208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:09 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:09.553278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:09.553905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:09.561188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.561747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.562180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:09.563203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.563585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.564089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:09.648141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:09.657545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-62434f95-5aba-4709-b932-896b5b14cce1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.109965 Sep 01 08:17:09.658244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 108/209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:09 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:09.718705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:09.721425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:09.732104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.732691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.733373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:09.734333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.734996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.735623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:09.837842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:09.851213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:09.852864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:09.853887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8255e732-a5b7-4eaf-9c02-b371bbd8c106 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.139459 Sep 01 08:17:09.855871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 102/210] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:09 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:09.985005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:09.985616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:09.992044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.992524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.993138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:09.993836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:09.994367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:09.994961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:10.104325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:10.122496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-37c27697-1dd5-447d-a2cd-ee19f7b634b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.140650 Sep 01 08:17:10.125472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 109/211] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:09 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:10.176661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:10.178373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:10.197557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:10.199796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:10.200840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:10.202379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:10.204008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:10.215737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:10.294476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:10.306659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-716712da-bf28-4083-8abc-f5af5fd40276 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.139874 Sep 01 08:17:10.308423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 103/212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:10 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:10.689480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:10.690706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:10.696907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:10.697382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:10.697805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:10.698560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:10.699133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:10.699548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:10.761717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:10.769929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d8e4a82-d5ba-4efb-b6d8-394ea0886c74 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084229 Sep 01 08:17:10.770543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 110/213] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:10 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:10.882235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:10.883025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:10.889142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:10.889618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:10.890044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:10.890761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:10.891204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:10.891619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:10.955634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:10.966774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:10.968433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:10.969305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-db442e0f-3fd6-4958-9204-c76e0d6ac4b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092118 Sep 01 08:17:10.969863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 104/214] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:10 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:11.163193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:11.163785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:11.170058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:11.170583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:11.171008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:11.171691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:11.172139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:11.172550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:11.240030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:11.248685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ccef46ec-70ea-4492-8f26-0b44178e8901 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090030 Sep 01 08:17:11.249263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 111/215] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:11 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:11.329454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:11.330054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:11.336921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:11.337399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:11.337833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:11.338553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:11.338996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:11.339411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:11.404063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:11.415175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b30a8b08-567f-4e7d-ae41-718791cc16b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089216 Sep 01 08:17:11.415681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 105/216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:11 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:11.791141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:11.791732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:11.797906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:11.798425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:11.798897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:11.799590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:11.800067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:11.800571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:11.868181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:11.876316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc819ac5-a3e5-483d-89db-73e098813418 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089006 Sep 01 08:17:11.876896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 112/217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:11 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:11.993203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:11.993807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:12.000040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.000524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.000956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.001647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.002699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.003610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.081425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:12.090726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:12.092171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:12.093289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aa5c733c-26d2-4c22-aae1-58263e28bdc3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.103996 Sep 01 08:17:12.093853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 106/218] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:11 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:12.269815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:12.270484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:12.276523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.277007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.277476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.278136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.278612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.279034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.346078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:12.362688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a3533381-5a64-4fe6-b63e-744d8416967e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.096833 Sep 01 08:17:12.363270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 113/219] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:12 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:12.436138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:12.436808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:12.443510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.444018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.444459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.445146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.445592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.446010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.510118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:12.518053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e0d9c71-757f-4a3c-9b65-a406dd5f0971 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085650 Sep 01 08:17:12.518646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 107/220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:12 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:12.898002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:12.898585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:12.905161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.905640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.906086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.906771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:12.907215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:12.907628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:12.985803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:12.993910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-412109f6-d631-48a9-80ef-bac3d4a4eb71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.100981 Sep 01 08:17:12.994513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 114/221] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:12 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:13.115605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:13.116568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:13.124108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:13.124886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:13.125322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:13.126015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:13.126494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:13.126913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:13.200776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:13.211220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:13.214864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:13.215984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8347e014-0cbd-4bdb-8549-d038d3d3332d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.104867 Sep 01 08:17:13.216541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 108/222] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:13 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:13.387316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:13.387920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:13.395215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:13.395831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:13.396313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:13.397005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:13.397445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:13.397855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:13.474868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:13.485918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-966911a8-6b63-4f4d-a84e-510469174517 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.104964 Sep 01 08:17:13.486946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 115/223] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:13 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:13.539529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:13.540127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:13.547372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:13.547849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:13.548272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:13.549504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:13.549951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:13.550473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:13.645616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:13.657689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-99430708-b79e-4f1a-b406-5721fcb247a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.122637 Sep 01 08:17:13.658535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 109/224] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:13 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:14.014553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:14.015164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:14.021957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.022458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.022891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.023596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.024046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.024481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.087220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:14.094908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-70dce657-008f-4df1-a53a-88fd8486ffbc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084460 Sep 01 08:17:14.095485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 116/225] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:14 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:14.241150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:14.241723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:14.248000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.248492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.248925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.249625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.250080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.250595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.318362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:14.326889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:14.328296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:14.329393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e3eeb849-7eb1-426c-957e-6331f7292f79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.093387 Sep 01 08:17:14.329945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 110/226] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:14 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:14.511180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:14.511788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:14.518676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.519595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.519791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.520491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.520960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.521372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.593078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:14.602397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4901e090-7f12-4bb8-aef1-a26267ed3b49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.094881 Sep 01 08:17:14.603203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 117/227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:14 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:14.678421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:14.679025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:14.685095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.685581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.686008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.686751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:14.687228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:14.687645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:14.750657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:14.760567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6649ce5f-eb3f-408c-8e23-5f2946857f81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085959 Sep 01 08:17:14.761429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 111/228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:14 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:15.116569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:15.117427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:15.124224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.124793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.125299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.126064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.126603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.127975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.192358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:15.200750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-efd18328-1248-4fa6-987b-ebefd975a2cf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088152 Sep 01 08:17:15.201336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 118/229] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:15 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:15.353581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:15.354363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:15.361742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.362367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.362910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.363719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.364394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.364901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.441349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:15.452129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:15.453956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:15.455278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c3beb652-b086-4579-b9cc-acb3abb6f952 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.105600 Sep 01 08:17:15.456523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 112/230] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:15 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:15.623395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:15.623990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:15.630191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.630703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.631130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.631912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.632545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.632961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.696394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:15.703855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f5675272-14c3-4ed9-8ce5-e4402b0e0882 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084225 Sep 01 08:17:15.704415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 119/231] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:15 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:15.782437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:15.783880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:15.790376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.791033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.791641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.792358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:15.792816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:15.793236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:15.870684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:15.880361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-30dec40c-52bc-463d-a306-6fa87dff0547 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.101529 Sep 01 08:17:15.880910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 113/232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:15 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:16.221452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:16.222151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:16.228282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.228760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.229187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.229869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.230337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.230753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.297842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:16.305877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-243a826c-043b-4275-9c8b-5c9a04991e8e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088615 Sep 01 08:17:16.306463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 120/233] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:16 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:16.485657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:16.486613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:16.492978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.493457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.493888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.494611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.495053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.495467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.560451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:16.569718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:16.571175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:16.572306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f5a1de1a-51af-46a0-ba6a-46a16500610b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090805 Sep 01 08:17:16.572870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 114/234] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:16 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:16.724630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:16.725149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:16.731187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.731658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.732086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.732757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.733204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.733622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.798098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:16.806225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9a144a43-7692-414d-86ea-94022a47b6e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085958 Sep 01 08:17:16.806812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 121/235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:16 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:16.901023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:16.901763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:16.909302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.909808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.910277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.910994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:16.911560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:16.911858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:16.974311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:16.982248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ef2f4a00-4d71-4d09-bcd5-839fdf70dff7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085117 Sep 01 08:17:16.982850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 115/236] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:16 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:17.326381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:17.326966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:17.333503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:17.333975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:17.334419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:17.335126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:17.335567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:17.335978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:17.399189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:17.402512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:17.407354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93343cdc-5565-4968-8cb5-317c124c59d1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084888 Sep 01 08:17:17.407927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 122/237] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:17 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:17.596662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:17.597233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:17.603388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:17.603863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:17.604290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:17.604971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:17.605415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:17.605823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:17.672795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:17.681673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:17.683118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:17.684203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0928b034-38e0-44b8-a824-1ec5ee040e3f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091995 Sep 01 08:17:17.684762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 116/238] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:17 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:17.827066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:17.827663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:17.834678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:17.835203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:17.835586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:17.836331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:17.836722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:17.837169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:17.901052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:17.909384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0df311d7-6f87-4874-b1f3-273fc73cf5b2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086126 Sep 01 08:17:17.909949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 123/239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:17 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:18.004477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:18.005204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:18.012703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.015003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.015003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:18.015003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.015003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.015382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:18.083705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:18.091458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-53e35bac-d725-40b3-be35-275090d6fa3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.091305 Sep 01 08:17:18.092019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 117/240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:17 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:18.429418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:18.429966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:18.436170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.436648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.440333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:18.440333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.440758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.442341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:18.502858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:18.510856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-43e0968b-c5ee-4662-bf92-eb320ca0947c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086039 Sep 01 08:17:18.511424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 124/241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:18 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:18.707362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:18.708170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:18.713977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.714532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.714963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:18.715650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.716096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.716509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:18.721417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:18.788846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:18.797572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:18.799494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:18.800822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2afa535e-241d-47d8-a651-136359ee49ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.097512 Sep 01 08:17:18.801383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 118/242] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:18 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:18.930618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:18.931220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:18.937781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.938276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.938715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:18.939571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:18.940154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:18.940572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:19.003022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:19.011054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf85f085-2ed7-4939-84e0-c90c2d765a1d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084297 Sep 01 08:17:19.011957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 125/243] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:18 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:19.113524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:19.114129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:19.120198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:19.120681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:19.121112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:19.121801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:19.122250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:19.122697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:19.292815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:19.301078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9a995317-ff9d-4fd5-aab3-44bb34c1c1c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.191393 Sep 01 08:17:19.301650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 119/244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:19 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:19.531820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:19.532426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:19.539154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:19.539629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:19.540057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:19.540875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:19.541236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:19.541658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:19.607992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:19.615701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd40cb38-f682-4c78-a31b-5462798dcaf3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087741 Sep 01 08:17:19.616264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 126/245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:19 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:19.824133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:19.824770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:19.831863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:19.834028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:19.835268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:19.836447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:19.837311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:19.838070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:19.905265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:19.914018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:19.915446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:19.916524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d8040829-c539-46c2-9a3d-19de5c386973 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.096308 Sep 01 08:17:19.917069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 120/246] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:19 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:20.032581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:20.033191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:20.039107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.039593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.040337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:20.040753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.041289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.041757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:20.105565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:20.113661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-67a4522f-2413-4e81-8fb8-3be2ae0ab48e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085062 Sep 01 08:17:20.114208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 127/247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:20 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:20.322062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:20.322786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:20.329962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.333388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.333956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:20.334810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.335337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.335825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:20.402557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:20.412992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3fc06fce-a5af-4390-ae62-d66a451babd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.095014 Sep 01 08:17:20.413803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 121/248] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:20 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:20.635729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:20.636944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:20.643613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.644373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.644789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:20.645533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.645983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.646441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:20.710207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:20.717727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4dcaf3a-0e7a-4a39-8112-0114837cbac2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085858 Sep 01 08:17:20.718298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 128/249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:20 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:20.939129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:20.939885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:20.946245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.946757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.947192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:20.947905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:20.948354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:20.948775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:21.012102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:21.021917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:21.023375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:21.024510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d58c6be9-340a-46d5-b715-bb39589bc61c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089369 Sep 01 08:17:21.025067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 122/250] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:20 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:21.134118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:21.134743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:21.140607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:21.141090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:21.141655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:21.142961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:21.143610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:21.144072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:21.203890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:21.212051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c56889a9-797a-4156-95c9-cc898735623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082432 Sep 01 08:17:21.212611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 129/251] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:21 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:21.434444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:21.435092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:21.441720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:21.442383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:21.442714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:21.443462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:21.443917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:21.444335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:21.513949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:21.522117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c985a2de-7ad1-4649-94a0-60463a7831eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.091476 Sep 01 08:17:21.522706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 123/252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:21 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:21.738783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:21.739472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:21.745931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:21.746594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:21.747032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:21.747728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:21.748171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:21.748590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:21.820659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:21.829463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd91ece6-09b6-4809-8fd6-e6e5dd9ca723 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.094465 Sep 01 08:17:21.842457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 130/253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:21 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:22.046800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:22.047412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:22.054236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.054748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.055264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.055985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.056436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.056855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.122720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:22.132730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:22.134543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:22.135765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b66fcaf-c2fa-4caf-b182-62f8212fa663 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092891 Sep 01 08:17:22.136556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 124/254] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:22 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:22.232983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:22.233608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:22.240241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.240711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.241133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.241800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.242245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.242682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.316934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:22.324804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75d51e89-81cf-4a6e-9778-c2c0af710f23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.095556 Sep 01 08:17:22.325756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 131/255] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:22 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:22.541753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:22.542469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:22.548742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.549023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.549459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.550151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.550633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.551058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.617662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:22.625227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0b836d78-64d3-4c8e-8764-6b966e3c1bfb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087483 Sep 01 08:17:22.625790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 125/256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:22 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:22.852834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:22.853431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:22.859418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.859894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.860434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.861448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:22.861939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:22.862510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:22.933818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:22.942035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c88e4d6-12d1-4975-9e20-3518e4ec7676 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093365 Sep 01 08:17:22.942643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 132/257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:22 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:23.159599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:23.160208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:23.166268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.166773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.167210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:23.167958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.168412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.168826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:23.230629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:23.239446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:23.240868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:23.241957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1512bdfc-0f81-40ae-a647-7ae4602feb73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086745 Sep 01 08:17:23.242611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 126/258] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:23 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:23.346509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:23.347325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:23.353929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.354460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.354959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:23.355917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.356446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.356871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:23.418068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:23.425758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9c7ad476-b66c-4bc9-9bf8-e277abdfb0fd tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084112 Sep 01 08:17:23.426327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 133/259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:23 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:23.645659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:23.646278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:23.652321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.652810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.653242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:23.653934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.654407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.654823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:23.721929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:23.736802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-20f6c333-c230-4569-a10e-90a2af1ea8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.095327 Sep 01 08:17:23.737379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 127/260] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:23 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:23.963660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:23.964258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:23.970200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.970932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.971462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:23.972159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:23.972608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:23.973024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:24.035552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:24.043203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5e4d5c8-0b62-4eb0-bb5a-856eacaeadba tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083425 Sep 01 08:17:24.043761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 134/261] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:23 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:24.265312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:24.265970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:24.268420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:24.276496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:24.276986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:24.279849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:24.280674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:24.281151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:24.281580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:24.348827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:24.358224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:24.359729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:24.361431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1522384e-c7c9-46f6-9c20-e797d006f557 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.099454 Sep 01 08:17:24.362209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 128/262] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:24 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:24.449026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:24.450310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:24.460505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:24.462284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:24.463525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:24.466016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:24.467046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:24.467965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:24.538461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:24.549155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b54f1147-252f-4886-8173-fe3ed4df8154 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.106263 Sep 01 08:17:24.550384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 135/263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:24 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:24.757455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:24.757993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:24.765383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:24.766112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:24.766765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:24.768193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:24.768777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:24.769484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:24.866173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:24.874444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-49bccfb4-3a08-4410-8cd8-2d2a3ba8577a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.120890 Sep 01 08:17:24.875017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 129/264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:24 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:25.065021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:25.066175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:25.068457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:25.077215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.077832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.078609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.079444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.080562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.081189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.149762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:25.157465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea2bf04b-1728-4253-8e9c-6299da4b1c78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.097316 Sep 01 08:17:25.158831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 136/265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:25 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:25.384688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:25.385352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:25.392054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.393579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.394200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.395167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.395694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.396276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.464108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:25.477121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:25.478605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:25.479744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7811d7a1-ac78-4087-81fd-93282b8145c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.099304 Sep 01 08:17:25.480304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 130/266] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:25 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:25.569679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:25.570303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:25.576331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.576858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.577318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.578050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.578520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.578935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.654420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:25.663279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24b647d5-d115-4bac-810f-bb1b8ea5a0aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.097376 Sep 01 08:17:25.674371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 137/267] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:25 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:25.897280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:25.897852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:25.904121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.904610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.905071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.905760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:25.906210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:25.906661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:25.969187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:25.977534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-429e497b-11d9-4858-8f27-2ec2814e506c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085053 Sep 01 08:17:25.978093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 131/268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:25 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:26.180746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:26.181358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:26.187519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:26.188014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:26.188500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:26.189240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:26.189935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:26.190376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:26.257518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:26.265058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7eb7097-d12f-4f48-a8dd-feaad3dd5c84 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088287 Sep 01 08:17:26.265603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 138/269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:26 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:26.504946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:26.505718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:26.511939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:26.512410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:26.512856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:26.513539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:26.513978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:26.514417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:26.577811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:26.593224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:26.594636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:26.596373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7d09ecd1-927f-4f47-b96a-cd978bb04797 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.096515 Sep 01 08:17:26.596968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 132/270] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:26 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:26.685449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:26.686046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:26.692298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:26.692770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:26.693199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:26.693873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:26.694343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:26.694761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:26.712654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:26.771236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:26.778814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a5a9ab19-05fd-4fac-b115-89eaed9af253 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.097283 Sep 01 08:17:26.779375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 139/271] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:26 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:26.999302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:26.999827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:27.006175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.006710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.007147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.007877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.008285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.008700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.071407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:27.079007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-07e36ffc-85a5-4538-819c-62e1e6a0ede4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083627 Sep 01 08:17:27.080069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 133/272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:26 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:27.287586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:27.288241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:27.294574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.295060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.295481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.296450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.296901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.297314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.364516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:27.372434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a424d9a7-b15a-43ce-8f99-2a8fcc406016 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089333 Sep 01 08:17:27.373316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 140/273] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:27 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:27.620680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:27.621281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:27.637008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.637582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.637936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.638674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.639120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.639537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.715261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:27.718797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:27.725546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:27.727057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:27.728186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bccb7fde-3bfb-4f4a-a30c-09c2630e633e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.111311 Sep 01 08:17:27.729080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 134/274] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:27 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:27.818140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:27.818943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:27.825445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.825910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.826370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.827065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:27.827516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:27.827940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:27.896087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:27.903584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7835af46-79fa-464b-a7fd-0d58fb1b975d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.107471 Sep 01 08:17:27.904137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 141/275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:27 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:28.100583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:28.101087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:28.107806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.107806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.108177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:28.108874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.109320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.109743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:28.170506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:28.178356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-00e3a3d5-fb4e-4d83-96ad-f4fa36d9e1c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081690 Sep 01 08:17:28.178925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 135/276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:28 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:28.394562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:28.395089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:28.401139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.401614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.402047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:28.402783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.403226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.403635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:28.467470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:28.475778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1052dfb0-330d-4736-bfd2-7defd65f1217 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085925 Sep 01 08:17:28.476344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 142/277] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:28 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:28.756256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:28.757464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:28.768189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.768898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.769634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:28.770513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.770959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.771374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:28.846128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:28.854694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:28.856120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:28.857231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f24b2933-0c2f-4874-a30c-b713c00f14ef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.105600 Sep 01 08:17:28.857790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 136/278] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:28 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:28.925249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:28.925947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:28.932391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.932880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.933345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:28.934037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:28.934521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:28.934942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:29.015900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:29.024276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-80f21b47-523d-4622-a84f-8ed430e01285 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.103283 Sep 01 08:17:29.024906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 143/279] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:28 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:29.199305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:29.199917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:29.207119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:29.207613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:29.208056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:29.208762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:29.209222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:29.209645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:29.275030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:29.285639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93e7754c-05bf-49c9-af27-4bfce7d572f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089922 Sep 01 08:17:29.286251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 137/280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:29 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:29.495982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:29.496573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:29.503649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:29.504149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:29.504592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:29.505400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:29.505896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:29.506358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:29.571009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:29.579619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-06d18eda-182a-42bc-b484-031504d37419 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087292 Sep 01 08:17:29.580367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 144/281] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:29 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:29.879490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:29.880115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:29.886115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:29.886632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:29.887058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:29.887734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:29.888174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:29.888584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:29.949687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:29.958295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:29.960079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:29.961763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4cf8b24f-4503-47f6-9bfa-f14da29ae1c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086147 Sep 01 08:17:29.963340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 138/282] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:29 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:30.044548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:30.045229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:30.051681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.052229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.052723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:30.053475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.053984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.054517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:30.136524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:30.145303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1dc7d633-8721-4146-8c0f-b2d00720393e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.104597 Sep 01 08:17:30.145867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 145/283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:30 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:30.306927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:30.307599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:30.313830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.314491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.314961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:30.315942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.316423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.316987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:30.379890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:30.389345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48a862ad-6b00-4772-a0a4-0a6b7712cc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086346 Sep 01 08:17:30.389842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 139/284] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:30 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:30.601273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:30.601972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:30.608104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.608585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.609016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:30.609722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.610138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.610594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:30.671506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:30.679106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eb7a18da-732b-47ba-b80e-3a96040c2ad8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081629 Sep 01 08:17:30.679700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 146/285] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:30 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:30.990811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:30.991415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:30.997432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.997913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.998372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:30.999059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:30.999507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:30.999955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:31.074633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:31.089517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:31.091386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:31.092803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-94b4b46e-b5d2-43f9-8c74-e3454d1154f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.105730 Sep 01 08:17:31.093363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 140/286] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:30 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:31.168906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:31.169264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:31.175352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:31.175837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:31.176259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:31.176950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:31.177391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:31.177813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:31.243237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:31.250905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-220f0394-bcb2-4ebe-8d71-df5770a7fb7c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086293 Sep 01 08:17:31.252305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 147/287] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:31 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:31.411147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:31.412000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:31.418591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:31.419085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:31.419521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:31.420215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:31.420670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:31.421092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:31.491728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:31.509779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e0f3c5cf-32f5-42ab-ae08-0e6ff61cbfa8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.103153 Sep 01 08:17:31.510388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 141/288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:31 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:31.700470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:31.701001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:31.707286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:31.707771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:31.708205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:31.708897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:31.709348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:31.709902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:31.773419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:31.781113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca281d3f-dbde-4f2a-982e-2382276d7278 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084548 Sep 01 08:17:31.781671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 148/289] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:31 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:32.116516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:32.117127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:32.123053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.123533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.123964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.124663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.125102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.125518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.190341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:32.198758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:32.200191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:32.201285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d6e5a436-b7ab-4bae-ad18-3d518db3e638 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088818 Sep 01 08:17:32.201827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 142/290] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:32 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:32.275102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:32.276161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:32.288708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.289214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.289659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.291724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.291724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.291724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.356128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:32.363589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5905071e-96a6-4e4e-8dd2-59c38a6c39e7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.094194 Sep 01 08:17:32.364143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 149/291] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:32 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:32.531918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:32.533217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:32.539632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.539632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.540320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.540762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.541241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.541659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.604408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:32.612850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3b1c3972-5580-45c1-96cb-8cd8af7d4aa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084647 Sep 01 08:17:32.614056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 143/292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:32 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:32.802648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:32.804106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:32.810769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.811304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.811908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.812605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:32.813047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:32.813489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:32.885270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:32.897412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8cd6f595-5dda-45df-9cde-d37dc57620a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.098645 Sep 01 08:17:32.898115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 150/293] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:32 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:33.227579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:33.228157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:33.234032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.234543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.234966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.236229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.236803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.237217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.296211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:33.305094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:33.306464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:33.307562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2cb46e53-91bc-4fa8-8902-a5c55afed875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084132 Sep 01 08:17:33.308122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 144/294] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:33 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:33.384086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:33.384697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:33.391095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.391579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.392043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.392746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.393194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.393614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.466025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:33.474353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfc742d1-c77f-4baf-8308-86d18299dea0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.094118 Sep 01 08:17:33.474914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 151/295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:33 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:33.634892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:33.635405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:33.641376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.641855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.642337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.643025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.643466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.643878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.705873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:33.713966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4cdd9c38-70d4-4c77-8a93-bc73632c3a71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083069 Sep 01 08:17:33.714562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 145/296] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:33 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:33.917355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:33.917954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:33.924007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.924787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.924984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.925584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:33.926027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:33.926492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:33.988086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:33.995625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-683a9c23-8361-43ed-9fd0-3ca9812fcdb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082146 Sep 01 08:17:33.996181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 152/297] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:33 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:34.331191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:34.331801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:34.337577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:34.338051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:34.338583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:34.339186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:34.339628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:34.340040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:34.399822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:34.407957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:34.409453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:34.410581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c63da8e4-917d-453c-9344-ac31f61aeeac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083814 Sep 01 08:17:34.411136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 146/298] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:34 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:34.495525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:34.496263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:34.502953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:34.503436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:34.503860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:34.504672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:34.505148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:34.505560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:34.567930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:34.575434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e4af84cc-45a8-407a-9c13-41aedcfe34ac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083787 Sep 01 08:17:34.575987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 153/299] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:34 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:34.734794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:34.735243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:34.742338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:34.742816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:34.743240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:34.743915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:34.744351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:34.744801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:34.807017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:34.815302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fa69f577-d0fe-4195-80ad-a6cf4803df8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084394 Sep 01 08:17:34.815864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 147/300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:34 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:35.015934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:35.016592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:35.022803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.023294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.023725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.024416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.024863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.025433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.086640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:35.094517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-92519b28-73f6-4168-a69a-a411d69c6a98 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082582 Sep 01 08:17:35.095619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 154/301] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:35 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:35.432720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:35.433320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:35.440290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.440719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.441152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.441837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.442379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.442738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.503361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:35.511942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:35.513381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:35.514491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4be05650-390a-474c-a8d8-337416d50c75 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085696 Sep 01 08:17:35.515043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 148/302] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:35 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:35.596338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:35.596941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:35.602923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.603399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.603824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.604501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.604944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.605355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.669351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:35.677554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-003fef04-09b2-4b23-8871-9f6af664b546 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085510 Sep 01 08:17:35.678106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 155/303] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:35 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:35.835767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:35.836564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:35.842650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.843133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.843566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.844251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:35.844699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:35.845656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:35.910339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:35.918898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1cbef046-d266-4dbe-b7b5-ed0d17a26ab1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087074 Sep 01 08:17:35.919381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 149/304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:35 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:36.116073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:36.117118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:36.123805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.124284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.124710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.125436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.125882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.126315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.132076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:36.197997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:36.206115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c13c5e90-75ef-4914-baa6-43c8351d22fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.094294 Sep 01 08:17:36.206706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 156/305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:36 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:36.537177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:36.537786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:36.543709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.544192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.544625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.545312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.545762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.546185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.607553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:36.616071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:36.617530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:36.618688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0b87bd4d-06c6-485d-a793-aa1d61049199 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085621 Sep 01 08:17:36.619254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 150/306] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:36 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:36.697847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:36.698492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:36.705238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.705906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.706369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.707064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.707515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.707936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.775416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:36.783146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dddeac03-01d1-41df-8bb6-8e085f1441f0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089124 Sep 01 08:17:36.783704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 157/307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:36 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:36.941613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:36.942214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:36.948146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.948626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.949056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.949736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:36.950184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:36.950642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:36.968146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:37.011662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:37.020961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-436b6dd8-1b63-4517-972c-b4254d3f5c7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083678 Sep 01 08:17:37.021995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 151/308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:36 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:37.226654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:37.227251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:37.233442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:37.233928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:37.234376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:37.235062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:37.236326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:37.237525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:37.319245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:37.327348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-da60a4cc-6988-4557-93d2-3cfe4a453cfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.104497 Sep 01 08:17:37.327916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 158/309] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:37 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:37.643668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:37.644614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:37.650650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:37.651186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:37.651618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:37.652341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:37.652788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:37.653206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:37.717876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:37.726632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:37.728276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:37.729197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-846e0c85-c439-42bb-8136-c8fa619fbd76 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090342 Sep 01 08:17:37.729750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 152/310] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:37 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:37.804215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:37.804820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:37.810975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:37.811439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:37.811868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:37.812548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:37.812986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:37.813396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:37.877084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:37.884695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8482f3aa-dab0-432b-b430-23ceec75e513 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084890 Sep 01 08:17:37.885251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 159/311] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:37 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:38.041101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:38.041707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:38.049078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.049605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.050143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.050906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.051390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.051847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.113418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:38.121208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-38936429-cc6c-4a2e-a987-7a344e210684 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084002 Sep 01 08:17:38.121769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 153/312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:38 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:38.349897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:38.350636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:38.364955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.364955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.364955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.364955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.365356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.365356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.423119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:38.430842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e27f731d-4175-4e6d-894e-7a50b2ddf634 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086921 Sep 01 08:17:38.431403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 160/313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:38 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:38.762490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:38.762490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:38.762490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.762490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.763202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.763202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.763202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.763202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.826307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:38.837157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:38.838720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:38.839994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-250be4d0-66ab-46d4-9f88-d90f2a4744b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091809 Sep 01 08:17:38.840607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 154/314] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:38 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:38.904894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:38.905502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:38.912163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.912577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.913011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.913701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:38.914150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:38.914599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:38.977744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:38.985152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c0b87e8-1109-4a2c-80af-7ec388ccf6c6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084074 Sep 01 08:17:38.986382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 161/315] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:38 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:39.142385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:39.142989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:39.149291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:39.149768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:39.150195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:39.150931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:39.151355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:39.151762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:39.223089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:39.230713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-707a203e-b1e8-49e8-b47c-efb563179033 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092715 Sep 01 08:17:39.231282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 155/316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:39 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:39.452512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:39.453018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:39.459754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:39.460239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:39.460675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:39.461369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:39.461820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:39.462243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:39.534838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:39.542319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-60fbebbc-b16d-47f2-83f5-56c30ae1fc78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093738 Sep 01 08:17:39.542861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 162/317] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:39 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:39.863150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:39.863731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:39.869553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:39.870024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:39.870481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:39.871161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:39.871604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:39.872016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:39.937384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:39.950904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:39.950904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:39.950904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-21dec503-5f93-4ebc-b30c-476b914a003c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090298 Sep 01 08:17:39.951297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 156/318] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:39 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:40.006945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:40.007644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:40.015311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.015311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.015917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:40.016287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.016749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.017598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:40.094349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:40.103770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e92734b0-ec36-423d-ab9d-f0a5ea8e5030 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.100279 Sep 01 08:17:40.103770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 163/319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:40 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:40.251383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:40.251992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:40.258001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.258511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.258937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:40.259618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.260056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.260525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:40.325997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:40.333766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-415ae7d2-e22a-4d57-b7a2-f66d380a0a36 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086239 Sep 01 08:17:40.334394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 157/320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:40 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:40.562430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:40.563038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:40.569437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.569920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.570449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:40.571098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.571553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.571976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:40.632947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:40.640534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eb8a9ef7-e8a3-49be-a79b-2b79f5e477d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081979 Sep 01 08:17:40.641089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 164/321] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:40 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:40.973243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:40.973913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:40.979751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.980219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.980642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:40.981313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:40.981767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:40.982180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:41.045166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:41.053435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:41.055063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:41.056481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f527fca7-0676-4a1a-bd6e-4660501f2cd7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087454 Sep 01 08:17:41.057037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 158/322] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:40 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:41.128075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:41.129091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:41.138139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:41.138962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:41.139651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:41.140758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:41.141465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:41.142768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:41.213215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:41.221927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-91575d25-10f1-41bb-9aab-6a1eef47df33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.101364 Sep 01 08:17:41.222521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 165/323] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:41 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:41.355084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:41.355695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:41.362943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:41.363432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:41.363870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:41.364565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:41.365071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:41.365439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:41.431062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:41.440024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6303d8f0-9b9d-48c6-a7e0-37e9951be0cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088742 Sep 01 08:17:41.440588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 159/324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:41 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:41.662090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:41.662676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:41.668587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:41.669071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:41.669504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:41.670179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:41.670651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:41.671067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:41.740143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:41.747729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47e66942-2e2f-44a4-a84a-da55343855b0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090344 Sep 01 08:17:41.748285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 166/325] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:41 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:42.079999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:42.081110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:42.087078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.087553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.087976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.088653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.089100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.089513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.150173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:42.159542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:42.161071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:42.162187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ca092ff-9f91-483c-91d6-e9daa4b8b2f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086088 Sep 01 08:17:42.162912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 160/326] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:42 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:42.242564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:42.243170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:42.249152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.249635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.250071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.250786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.251239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.251661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.317321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:42.324984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b9e87c34-8894-4174-9c49-60388c71a087 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086252 Sep 01 08:17:42.325548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 167/327] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:42 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:42.461403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:42.461932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:42.468171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.468663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.469102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.469802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.470554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.470979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.535544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:42.543789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc949420-79a9-44b8-bcb9-78de780b4940 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086036 Sep 01 08:17:42.544150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 161/328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:42 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:42.769292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:42.769819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:42.775717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.776201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.776633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.777330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:42.777779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:42.778199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:42.843042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:42.850982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f1f70a9-e5e4-47ae-a3b9-e79ae4c651ab tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085966 Sep 01 08:17:42.851533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 168/329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:42 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:43.185909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:43.186543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:43.192470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.192949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.193381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.194065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.194543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.194965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.257494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:43.265983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:43.267450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:43.268762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-81864f5e-9ecc-4942-a2cc-0eb0f48395db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086727 Sep 01 08:17:43.269322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 162/330] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:43 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:43.347517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:43.348120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:43.354231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.354749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.355193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.355888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.356337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.356762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.422721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:43.430932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-55d77fcc-9b5f-4ec8-b0fc-5bfe44ff5ed3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.088235 Sep 01 08:17:43.431481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 169/331] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:43 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:43.564230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:43.564828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:43.571595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.572062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.572486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.573176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.573625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.574037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.637916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:43.646683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1995f177-9493-438f-b357-bf68c09d01b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086162 Sep 01 08:17:43.647263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 163/332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:43 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:43.872337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:43.872947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:43.881750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.882245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.882887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.883602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:43.885305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:43.885425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:43.947242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:43.954969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e556e2ee-ed45-4f72-be74-5623546921a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086443 Sep 01 08:17:43.956142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 170/333] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:43 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:44.292012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:44.292613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:44.298433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.299420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.299833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:44.300504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.300957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.301600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:44.363423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:44.371582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:44.373012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:44.374140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-08fb80d4-e309-4362-9539-74487369a2d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085957 Sep 01 08:17:44.374735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 164/334] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:44 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:44.451669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:44.452265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:44.458618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.459101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.459534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:44.460219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.460662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.461101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:44.530492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:44.538959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6f5f74df-24db-474f-acad-7284958e8ed1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.091224 Sep 01 08:17:44.539530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 171/335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:44 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:44.668083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:44.668692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:44.674609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.675101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.675539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:44.676236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.676694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.677109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:44.743099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:44.750974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8edc6a77-6577-4507-a86e-c9c92b4b32be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086565 Sep 01 08:17:44.751542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 165/336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:44 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:44.981357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:44.981940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:44.989042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.989527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.989959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:44.990812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:44.991270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:44.991693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:45.056879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:45.060382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:45.066073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0601c6c7-8dfe-44f8-81a5-e0d07b3e0018 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092911 Sep 01 08:17:45.066679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 172/337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:44 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:45.398180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:45.398903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:45.404879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:45.405453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:45.405960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:45.406744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:45.407265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:45.407688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:45.470209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:45.478638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:45.480059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:45.481146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09d6b117-f644-4d09-ab90-14f5758ae728 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087527 Sep 01 08:17:45.481688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 166/338] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:45 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:45.559844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:45.560475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:45.567185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:45.567667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:45.568097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:45.568785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:45.569244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:45.569662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:45.633961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:45.641597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-febfc75d-e93d-4ce7-970a-0b4decda36b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085577 Sep 01 08:17:45.642147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 173/339] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:45 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:45.771528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:45.772130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:45.778014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:45.778528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:45.778960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:45.779634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:45.780084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:45.780500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:45.842366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:45.853784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-85dab5be-a013-441c-98d4-8d77df0a3ef1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086078 Sep 01 08:17:45.854405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 167/340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:45 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:46.087659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:46.088380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:46.095138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.095627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.096688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.097383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.097824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.098239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.160469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:46.167908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-abfec2d7-2336-4120-aa11-20b2a4866aef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084542 Sep 01 08:17:46.168606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 174/341] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:46 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:46.504507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:46.505120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:46.512177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.512657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.513093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.513786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.514239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.514688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.519060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:46.579817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:46.588615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:46.590048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:46.591185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-668125e4-fd4a-4867-8110-93b0161302a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091259 Sep 01 08:17:46.591736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 168/342] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:46 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:17:46.662897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:46.663507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:46.669796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.670291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.670719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.671412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.671856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.672271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.735909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:46.744122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fb62cfe7-c756-4a0a-a370-562dbaa22c1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085217 Sep 01 08:17:46.744684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 175/343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:46 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:46.874005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:46.874628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:46.881455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.881936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.882414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.883096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:46.883544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:46.883964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:46.945015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:46.953182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9cfd06ba-fe0c-4187-8d3d-d27f32a36338 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082926 Sep 01 08:17:46.953764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 169/344] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:46 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:47.188587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:47.189216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:47.195390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.195880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.196305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:47.197000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.197448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.197867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:47.260920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:47.269575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea2e1537-afbb-460f-87f8-4d8c37f75810 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084924 Sep 01 08:17:47.270139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 176/345] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:47 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:47.614397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:47.615024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:47.621207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.621688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.622113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:47.622836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.623310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.623724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:47.685067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:47.693835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:47.695296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:47.696383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bed03271-c57f-4c60-a0e8-8d94698c589d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086111 Sep 01 08:17:47.696943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 170/346] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:47 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:47.764962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:47.765545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:47.772465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.772970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.773401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:47.774096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.774576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.775052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:47.840638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:47.849852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5e1c2481-41e8-4b16-85e2-5e67757c98cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.088833 Sep 01 08:17:47.850441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 177/347] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:47 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:47.974382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:47.974981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:47.980784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.981253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.981678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:47.982369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:47.982813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:47.983228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:48.045492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:48.054864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47d9168a-7644-4f49-b3e2-9fd998ce5aaa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084189 Sep 01 08:17:48.055439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 171/348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:47 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:48.289900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:48.290528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:48.296723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:48.297135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:48.297559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:48.298249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:48.298751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:48.299669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:48.360030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:48.368414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2efbaddb-349c-492b-9fdc-7c05eafe855d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082283 Sep 01 08:17:48.368966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 178/349] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:48 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:48.719138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:48.720016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:48.726891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:48.727374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:48.727808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:48.728564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:48.729016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:48.729440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:48.795931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:48.807369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:48.808721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:48.809843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19f6a811-443e-4876-be66-26331e6cd540 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094580 Sep 01 08:17:48.810436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 172/350] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:48 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:48.871067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:48.871674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:48.877692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:48.878173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:48.878725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:48.879549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:48.879860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:48.880278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:48.945315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:48.952840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0cf364fb-6617-4f0a-b69d-484ea4ff3c45 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087120 Sep 01 08:17:48.953391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 179/351] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:48 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:49.075249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:49.075768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:49.082187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.082718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.083145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:49.083819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.084291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.084707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:49.145319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:49.152944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee053da2-685f-477a-b79a-cd51ea86c7c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081489 Sep 01 08:17:49.153503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 173/352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:49 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:49.389115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:49.389706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:49.395670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.396147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.396575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:49.397264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.397707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.398120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:49.460543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:49.468246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eeb66cff-7a88-4dc4-b43f-1f06c018ed7e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083112 Sep 01 08:17:49.468794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 180/353] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:49 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:49.832747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:49.833347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:49.845167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.845654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.846085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:49.846884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.847827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.848241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:49.915009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:49.923238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:49.924689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:49.926299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a92dc50-98c4-4323-bb65-b5c907dca8b7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.097781 Sep 01 08:17:49.926878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 174/354] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:49 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:49.974583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:49.975340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:49.988314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.989417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.990180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:49.991464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:49.992242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:49.992981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:50.062523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:50.070823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-62fe8aaa-5e13-4d1b-9a71-2238dd76d02c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.100410 Sep 01 08:17:50.071374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 181/355] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:49 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:50.173540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:50.174135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:50.180132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:50.180607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:50.181053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:50.181749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:50.182196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:50.182643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:50.245082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:50.252588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e547c37c-a569-4f3a-b6d2-fa78f568e3f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082838 Sep 01 08:17:50.253689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 175/356] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:50 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:50.489491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:50.490096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:50.496249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:50.496730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:50.497156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:50.497843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:50.498311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:50.498748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:50.563499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:50.572160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2655c31d-f580-461e-b830-838ef41cf146 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087003 Sep 01 08:17:50.572722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 182/357] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:50 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:50.948850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:50.949458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:50.956566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:50.957127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:50.957659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:50.958538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:50.958987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:50.959409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:51.028487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:51.037755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:51.039374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:51.040520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ff388d60-5ece-4317-83f7-58076aa6887b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095587 Sep 01 08:17:51.041078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 176/358] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:50 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:51.092068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:51.092677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:51.100091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:51.100575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:51.101000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:51.101704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:51.102146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:51.102700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:51.169257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:51.178014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-34857a68-79b0-4c14-9dd6-3459ed442d4c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089948 Sep 01 08:17:51.178652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 183/359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:51 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:51.273126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:51.273736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:51.280336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:51.280815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:51.281244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:51.281923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:51.282415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:51.282836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:51.342409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:51.351337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0506d7bb-03c0-4c95-8206-da4740405444 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082056 Sep 01 08:17:51.351902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 177/360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:51 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:51.593204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:51.593801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:51.600827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:51.601341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:51.601770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:51.602503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:51.602965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:51.603390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:51.665180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:51.672819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-12e1f5cc-1d88-4b94-b6ca-93de16c74187 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083723 Sep 01 08:17:51.673379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 184/361] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:51 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:52.063193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:52.063959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:52.066004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:52.071231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.071706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.072131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.072811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.073257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.073665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.139507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:52.149054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:52.150519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:52.151612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-67e55aaf-7460-4a8b-a098-443db248b648 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092171 Sep 01 08:17:52.152168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 178/362] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:52 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:52.198624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:52.199225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:52.205475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.205959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.207004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.207684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.208135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.208555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.270288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:52.278133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-473e0bf9-837e-498e-affb-98ecbec34e80 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083293 Sep 01 08:17:52.278738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 185/363] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:52 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:52.372853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:52.373373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:52.381112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.381584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.382012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.382722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.383168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.383692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.458654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:52.466297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec47758b-89f3-4422-8729-fdb57e773d87 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097318 Sep 01 08:17:52.466858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 179/364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:52 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:52.696426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:52.696969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:52.699194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:52.705301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.705795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.706233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.706960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:52.707531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:52.707962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:52.791109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:52.804936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-22521e5b-d145-4902-9df4-e29be8cce918 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.114698 Sep 01 08:17:52.805757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 186/365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:52 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:53.173052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:53.173655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:53.180898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.181370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.181794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.182505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.182949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.183361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.245524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:53.253497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:53.254956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:53.256049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f08e0384-a762-491d-8971-6f289105acef tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086817 Sep 01 08:17:53.256594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 180/366] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:53 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:53.298857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:53.299458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:53.305298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.305771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.306201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.306898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.307377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.307768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.370345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:53.378773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-06c7da6c-7317-4b8c-8b15-0aa4a00d2119 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083231 Sep 01 08:17:53.379345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 187/367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:53 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:53.486667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:53.487275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:53.493777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.494279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.494716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.495418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.495866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.496282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.558859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:53.566496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dec89c8d-37a8-431f-811a-65abf00290c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083627 Sep 01 08:17:53.567061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 181/368] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:53 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:53.826307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:53.826920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:53.834171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.834734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.835151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.836173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:53.836615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:53.837151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:53.915305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:53.923451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8e6432c4-5679-4178-8424-412d4ab0a593 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.100946 Sep 01 08:17:53.924052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 188/369] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:53 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:54.278631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:54.279220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:54.285079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.285556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.286007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:54.286835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.287279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.287718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:54.350633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:54.358784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:54.360208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:54.361297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a2d19fea-cefe-47c0-a8bc-5f0834f32587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086543 Sep 01 08:17:54.361843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 182/370] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:54 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:54.404871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:54.405390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:54.412125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.412664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.413478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:54.413836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.414311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.414730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:54.432961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:54.486914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:54.495393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-260a6792-9cbe-42c6-b3cb-2319c11fb171 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.094346 Sep 01 08:17:54.495966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 189/371] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:54 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:54.587502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:54.588163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:54.594485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.595234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.595658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:54.596358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.597286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.597701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:54.656852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:54.665007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2721a0cf-a65c-4fb6-8e50-8658a6f7ef74 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081297 Sep 01 08:17:54.665558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 183/372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:54 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:54.944992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:54.945674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:54.951766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.952244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.952673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:54.953358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:54.953805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:54.954222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:55.014489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:55.023025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9760b9b-6a6a-4574-805a-f520accdbd01 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082455 Sep 01 08:17:55.023598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 190/373] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:54 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:17:55.386926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:55.386926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:55.392017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:55.392534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:55.392948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:55.394287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:55.395064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:55.395491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:55.457968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:55.461389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:55.472218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:55.474174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:55.475905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5ef91f15-6d93-40be-847b-334f0a46beb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094419 Sep 01 08:17:55.476461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 184/374] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:55 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:55.515753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:55.516349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:55.522212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:55.522717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:55.523142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:55.523810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:55.524252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:55.524665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:55.587786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:55.595773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e361e0b2-6b2a-42da-bcdf-f98c040dc73f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083845 Sep 01 08:17:55.596333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 191/375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:55 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:55.686205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:55.686829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:55.693555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:55.694026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:55.694537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:55.695219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:55.695663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:55.696072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:55.757435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:55.764944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9f1b3baf-5b20-4aea-baa2-abda1784719a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082627 Sep 01 08:17:55.765495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 185/376] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:55 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:56.046712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:56.047306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:56.054027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.054540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.054966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.055646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.056087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.056529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.118490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:56.126616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e1f51911-b2d9-459f-9bd5-fa575b5e2141 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083935 Sep 01 08:17:56.127192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 192/377] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:56 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:56.498569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:56.499557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:56.506401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.507013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.507749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.508611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.509111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.509658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.570655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:56.579038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:56.580458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:56.582067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4080fced-008b-4e9b-9931-e9032c3a940a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087544 Sep 01 08:17:56.582740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 186/378] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:56 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:56.616786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:56.617382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:56.623236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.623711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.624131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.624800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.625242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.625652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.686975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:56.695644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4009ccdd-001b-4c85-9f9b-8e7b59f3b5e0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082469 Sep 01 08:17:56.696131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 193/379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:56 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:56.786459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:56.787063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:56.792945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.793416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.793844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.794552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:56.795002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:56.795419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:56.856477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:56.863995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a96c8ef-4a7a-4741-ab19-f1eaaf263550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081580 Sep 01 08:17:56.864547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 187/380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:56 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:57.149173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:57.149781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:57.155610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.156084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.156512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.157186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.157637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.158080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.217028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:57.224789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75c153a7-17a5-4a1d-874f-e40fd6ec3c21 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.079521 Sep 01 08:17:57.225344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 194/381] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:57 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:57.607547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:57.608640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:57.615163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.615637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.616062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.616741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.617187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.617603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.678667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:57.686889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:57.688301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:57.689587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-27878fc4-b837-4606-9498-24a158dbf98d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086057 Sep 01 08:17:57.690130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 188/382] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:57 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:57.717642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:57.718288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:57.735524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.736020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.736460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.737299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.737808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.738234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.801221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:57.808842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f8d11863-9955-49a8-9f62-cd3c1eda5d4e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.095635 Sep 01 08:17:57.809407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 195/383] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:57 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:57.884384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:57.884890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:57.890727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.891202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.891623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.892292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:57.892738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:57.893149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:57.952771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:57.960841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-872b24be-a6e4-4c25-98fd-c80c044fb29d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080348 Sep 01 08:17:57.961395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 189/384] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:57 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:58.245558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:58.246086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:58.251908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.252386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.252815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:58.253493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.253973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.254618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:58.312769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:58.320254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-81817a2c-66f0-44a6-bef9-eb61e5d1b151 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.078665 Sep 01 08:17:58.320829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 196/385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:58 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:58.712724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:58.713415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:58.719660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.720127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.720551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:58.721232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.721673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.722084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:58.798987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:58.807139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:58.808564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:58.809646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bba496fb-a1f2-4238-b0a2-1ef2d15dc153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.100857 Sep 01 08:17:58.810184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 190/386] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:58 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:58.828640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:58.829238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:58.835745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.836274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.836754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:58.837645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.838328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.838934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:58.902794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:58.910462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8178c348-c5bc-4a15-bb3d-c8c38c50bfd9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085421 Sep 01 08:17:58.911054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 197/387] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:58 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:58.981269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:58.981796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:58.987902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.988418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.988856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:58.989538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:58.989987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:58.990442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:59.050789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:59.058375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-319e04fa-eba1-4195-b404-20115caab214 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080953 Sep 01 08:17:59.058943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 191/388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:58 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:59.340588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:59.341187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:59.347254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:59.347735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:59.348240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:59.348919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:59.349365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:59.349782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:59.411545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:59.419151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-627ab7b6-0770-4e90-9fda-c5221dfa536e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082361 Sep 01 08:17:59.419702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 198/389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:59 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:17:59.832542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:59.833208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:59.840067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:59.840679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:59.841219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:59.841907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:59.842381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:59.842795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:59.903896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:59.912503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:59.913922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:17:59.915069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-25986be2-2bc9-434e-8828-915c329752f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086544 Sep 01 08:17:59.915578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 192/390] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:17:59 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:17:59.931159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:17:59.931789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:17:59.938781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:59.939259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:59.939685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:17:59.940365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:17:59.940807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:17:59.941244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:00.006792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:00.014824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09652dfb-516d-4fe4-9a80-62a596988fda tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087265 Sep 01 08:18:00.015628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 199/391] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:17:59 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:00.079342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:00.079940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:00.086803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:00.087215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:00.087636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:00.088321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:00.088764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:00.089178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:00.150903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:00.158397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-029da8c2-a0dd-4cd8-abe9-1ceed27f9e9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082823 Sep 01 08:18:00.159171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 193/392] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:00 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:00.441784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:00.442468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:00.448424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:00.448902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:00.449327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:00.450007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:00.450494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:00.450915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:00.511389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:00.518960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-86bf8156-55ae-401f-a21b-c2e827003f9f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081104 Sep 01 08:18:00.519659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 200/393] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:00 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:00.938141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:00.938847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:00.944833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:00.945309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:00.945740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:00.946463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:00.946910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:00.947326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:01.010621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:01.018237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:01.020261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:01.021336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7464a4ba-afb7-4d95-af9f-ae7eb06860a4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087047 Sep 01 08:18:01.021878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 194/394] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:00 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:01.035865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:01.037179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:01.043552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:01.044071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:01.044490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:01.045180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:01.045629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:01.046047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:01.178665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:01.179288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:01.185593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:01.186085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:01.186548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:01.187255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:01.187713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:01.188137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:01.224583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:01.232850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-835905d9-7bb8-4753-9309-4d1cf2486364 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.200716 Sep 01 08:18:01.233421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 201/395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:01 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:01.251543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:01.259762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b418a9b3-76c3-4a30-b799-df5aa0373461 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085145 Sep 01 08:18:01.260323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 195/396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:01 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:01.539103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:01.539702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:01.545942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:01.546491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:01.546940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:01.547633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:01.548077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:01.548521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:01.614409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:01.622168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65266115-98b1-4094-b2c2-fc0c855e586b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086912 Sep 01 08:18:01.622760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 202/397] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:01 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:02.045105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:02.045692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:02.053699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.054181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.054635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.055332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.055777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.056194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.121304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:02.130551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:02.132002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:02.133120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1fd27f95-9b38-4ac0-9d9b-aa67ed56c29e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091940 Sep 01 08:18:02.133675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 196/398] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:02 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:02.253487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:02.254834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:02.261221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.261842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.262366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.263130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.263647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.264145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.281040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:02.281647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:02.287826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.288312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.288735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.289423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.289868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.290299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.329572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:02.337305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52b1f89b-8b00-48ad-b76c-8c8bb418080a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087997 Sep 01 08:18:02.337871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 203/399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:02 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:02.357151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:02.369848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be372f29-08c9-426a-83df-b07882a8eb45 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088306 Sep 01 08:18:02.369848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 197/400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:02 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:02.642980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:02.643582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:02.649951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.650465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.650896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.651584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:02.652056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:02.652472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:02.713690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:02.721380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-898595de-e9c2-4599-bb35-23a6c50719ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082181 Sep 01 08:18:02.721935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 204/401] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:02 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:03.157246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:03.158011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:03.164377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.164858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.165323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.166017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.166488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.166902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.228644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:03.236497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:03.237920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:03.239709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-81730701-9b10-400a-a0d6-e465d8c42961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087463 Sep 01 08:18:03.240264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 198/402] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:03 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:03.357210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:03.357796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:03.364495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.364980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.365415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.366109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.366586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.367004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.384804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:03.385399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:03.391321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.391800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.392299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.392907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.393351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.393761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.447541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:03.455070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e10aef34-5d69-42a2-b9e6-c45f66a85c93 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.101632 Sep 01 08:18:03.455629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 205/403] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:03 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:03.466534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:03.475428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19f8e0f0-0e7d-4e02-89ef-1aeff22feffa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094356 Sep 01 08:18:03.476021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 199/404] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:03 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:03.742287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:03.742851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:03.748663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.749141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.749573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.750284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:03.750725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:03.751144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:03.755092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:03.811151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:03.818956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6a3dcacd-3fc3-46e4-9fcb-946a93fa89a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080561 Sep 01 08:18:03.819542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 206/405] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:03 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:04.262717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:04.263322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:04.269335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.270337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.270768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.271451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.271891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.272305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.332771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:04.340686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:04.342100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:04.343203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d909cd09-7955-4e9d-bfde-c07162643664 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084358 Sep 01 08:18:04.343749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 200/406] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:04 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:04.480111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:04.481306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:04.491111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.491601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.492038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.492730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.493176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.493595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.496302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:04.496907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:04.502835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.503318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.504351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.505322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.505778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.506402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.525632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:04.566770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:04.574435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1a3058b6-c650-40f0-81b6-b1902162e98b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.101837 Sep 01 08:18:04.575008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 207/407] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:04 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:04.585509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:04.593159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-66277261-525d-4752-8f6f-5cc68965c143 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.100636 Sep 01 08:18:04.593719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 201/408] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:04 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:04.839447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:04.840104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:04.846364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.846843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.847271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.847945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:04.848387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:04.848799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:04.908012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:04.915691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d97e2462-df4a-4e13-9f0d-af0c365aedfc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080259 Sep 01 08:18:04.916245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 208/409] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:04 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:05.365890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:05.366500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:05.372906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.373393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.373818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:05.374546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.375003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.375414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:05.449565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:05.458437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:05.459873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:05.460961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-833b5553-f191-49e8-a516-fc7e7df6d56e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.099438 Sep 01 08:18:05.461656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 202/410] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:05 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:05.595777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:05.596380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:05.602705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.603282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.603706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:05.604383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.604822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.605232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:05.614778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:05.615388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:05.621447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.621867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.622323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:05.623025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.623473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.623892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:05.669025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:05.676801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-437c7256-d591-43fd-886c-1350eb108e8c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085015 Sep 01 08:18:05.677368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 209/411] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:05 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:05.697585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:05.705509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-396d2da2-ec1b-4ae8-b186-867df8c98bf8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094519 Sep 01 08:18:05.706062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 203/412] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:05 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:05.936559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:05.937128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:05.943626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.944096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.944523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:05.945205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:05.945651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:05.946069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:06.010379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:06.017919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16c9dbd2-eef9-48b6-b9d4-47749949ad76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085352 Sep 01 08:18:06.018510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 210/413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:05 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:06.483588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:06.484514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:06.490976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:06.491934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:06.492473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:06.493211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:06.493660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:06.494136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:06.563651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:06.572301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:06.573726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:06.574903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0b810988-160b-4aa1-915c-dffce2a0f3ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095474 Sep 01 08:18:06.575460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 204/414] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:06 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:06.698547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:06.699058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:06.704928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:06.705398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:06.705830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:06.706642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:06.707679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:06.708147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:06.726571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:06.727181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:06.733127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:06.733609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:06.734036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:06.734779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:06.735229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:06.735647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:06.770084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:06.777679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac85de88-1771-41c7-8c92-f2ee41338d0f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083162 Sep 01 08:18:06.778235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 211/415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:06 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:06.800935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:06.808968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a567efe-c58c-4d0e-bffb-10dce71757f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086359 Sep 01 08:18:06.809798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 205/416] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:06 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:07.038206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:07.038841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:07.044743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.045221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.045655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.046366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.046819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.047248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.108522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:07.116862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-990a6e74-3553-4a9f-bba9-943adb9bcfd8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082609 Sep 01 08:18:07.117421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 212/417] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:07 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:07.597876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:07.598704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:07.605550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.606016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.606482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.607336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.607788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.608199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.668175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:07.675925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:07.677333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:07.678459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-51af505f-bd50-47dd-9d3d-46d77900f3b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085295 Sep 01 08:18:07.678999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 206/418] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:07 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:07.798180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:07.798815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:07.805154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.805631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.806062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.806769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.807214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.807625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.829487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:07.830081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:07.836759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.837397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.837693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.838597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:07.839009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:07.839456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:07.869132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:07.876788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ab27f8f-593c-4bef-82b6-2fe5f3c1f799 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082779 Sep 01 08:18:07.877350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 213/419] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:07 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:07.903337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:07.911211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-23f02bf7-2ced-411b-a3a2-789cf156450b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085370 Sep 01 08:18:07.911632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 207/420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:07 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:08.141381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:08.142314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:08.149812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.150662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.151261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.152172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.152991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.153415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.215537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:08.223760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e21e0d4b-973c-4629-aa88-d2f4e6a39e30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086535 Sep 01 08:18:08.224312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 214/421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:08 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:08.700866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:08.701495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:08.707615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.708097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.708587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.709282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.709853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.710297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.774123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:08.782473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:08.783905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:08.785132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5818f24e-1287-4228-990c-8cd60ef5074f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088063 Sep 01 08:18:08.785887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 208/422] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:08 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:08.899575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:08.900184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:08.906165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.906680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.907115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.907807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.908258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.908680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.932792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:08.933398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:08.939459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.939956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.940397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.941622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:08.942440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:08.942920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:08.975597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:08.992210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ba3c2320-30c8-4b78-8551-cb611a79b735 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.096385 Sep 01 08:18:08.992772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 215/423] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:08 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:09.010186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:09.017924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a6716b7d-9a9f-432d-93b0-98e4041a27d5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088964 Sep 01 08:18:09.018521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 209/424] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:08 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:09.244533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:09.245161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:09.251251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:09.251739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:09.252165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:09.252845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:09.253290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:09.253712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:09.316759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:09.324378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd637e87-201a-4261-beb5-2724616bbed0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083657 Sep 01 08:18:09.324929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 216/425] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:09 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:09.807965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:09.808676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:09.818619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:09.819254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:09.819700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:09.820422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:09.820874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:09.821299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:09.883991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:09.891965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:09.893385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:09.895307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3fc1e6b6-ad83-4fe5-b46d-5562ea8a2ad0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091087 Sep 01 08:18:09.895855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 210/426] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:09 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:10.013923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:10.014212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:10.021806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.022396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.022775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.023775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.024484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.024983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.039240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:10.039869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:10.046014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.046548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.046976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.047863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.048646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.049412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.099271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:10.107021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc9aed6b-01a5-4089-96d3-6b0a551ba729 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.097653 Sep 01 08:18:10.107590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 217/427] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:10 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:10.121865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:10.130112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bae7a421-2f7d-4322-8b7a-6aebef89631c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096016 Sep 01 08:18:10.130697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 211/428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:10 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:10.345326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:10.345957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:10.352321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.352797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.353219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.353893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.354362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.354776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.413875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:10.421354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b31b635d-4ea4-46ce-9b5a-99835e3c699d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080187 Sep 01 08:18:10.421898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 218/429] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:10 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:10.918236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:10.918855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:10.924893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.926009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.926797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.927526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:10.927981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:10.928406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:10.989305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:10.997481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:10.998933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:11.000017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28b7c7a9-c715-4af7-b739-92ab2c78cb3e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085672 Sep 01 08:18:11.000563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 212/430] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:10 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:11.127520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:11.128121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:11.134226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:11.134742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:11.135169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:11.135865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:11.136305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:11.136720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:11.150845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:11.151442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:11.158160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:11.158678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:11.159109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:11.160363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:11.161425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:11.161425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:11.202222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:11.210879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9eef3da8-c163-47a5-9658-ca9a586d6cd6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087038 Sep 01 08:18:11.211586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 219/431] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:11 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:11.231297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:11.239587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61308ec8-c6e1-497a-84a0-4023d097b151 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092611 Sep 01 08:18:11.240077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 213/432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:11 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:11.441656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:11.442537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:11.448662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:11.449139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:11.449566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:11.450246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:11.450734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:11.451155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:11.511677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:11.519249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a6ff9e8-304d-4492-a150-ae73a571caf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082009 Sep 01 08:18:11.519804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 220/433] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:11 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:12.025231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:12.025860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:12.032491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.033069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.033586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.034323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.035414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.035834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.100256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:12.108801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:12.110245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:12.111404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0d3e772b-b538-4a04-9b0b-91893bdf48f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090216 Sep 01 08:18:12.111966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 214/434] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:12 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:12.232333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:12.232933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:12.239817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.240280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.240706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.241398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.241836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.242249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.260113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:12.260713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:12.266506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.266982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.267407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.268242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.268930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.269701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.307512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:12.315236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9e9376ad-53f0-4182-836b-7009842a54b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086660 Sep 01 08:18:12.315839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 221/435] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:12 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:12.335961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:12.343447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c5e41eb1-bcfe-4e29-9a5d-92affa8342df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087129 Sep 01 08:18:12.343987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 215/436] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:12 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:12.539472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:12.540080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:12.546100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.546624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.547061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.547750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:12.548197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:12.548622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:12.608821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:12.612207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:12.617256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cbf4aee6-9a0e-44f8-b3a4-51260c418ee2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081625 Sep 01 08:18:12.617814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 222/437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:12 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:13.135578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:13.136181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:13.142717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.143398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.153158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.154139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.154498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.155476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.240694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:13.249085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:13.250530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:13.251638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f09f0234-af2e-4856-bde2-8e2f0f950d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.120112 Sep 01 08:18:13.252184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 216/438] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:13 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:13.336223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:13.336831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:13.343067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.343549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.344232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.344938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.345384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.345799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.364377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:13.364986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:13.370921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.371426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.371864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.372546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.372998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.373417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.406882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:13.414564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-776bed2e-9c99-4c29-8a35-b9edb1a9690a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082822 Sep 01 08:18:13.415114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 223/439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:13 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:13.438954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:13.447604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-097c212d-ebd5-4d1c-b493-0899b753e2d7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087252 Sep 01 08:18:13.448171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 217/440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:13 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:13.639928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:13.640692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:13.647026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.647511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.647943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.648642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:13.649090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:13.649514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:13.713886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:13.721678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-46781ce5-97df-4bc8-9eaa-c3837f2ed7e1 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085738 Sep 01 08:18:13.722237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 224/441] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:13 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:14.276053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:14.276656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:14.282817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.284219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.285274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.286101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.286846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.287276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.292316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:14.366765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:14.375416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:14.377450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:14.378932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0d9bd81d-9a0d-4476-8ac1-6175d07c3239 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.106769 Sep 01 08:18:14.380574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 218/442] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:14 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:14.434574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:14.435096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:14.442087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.442661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.443091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.443797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.444245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.444663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.469652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:14.470377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:14.477259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.477765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.478187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.478896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.479335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.479747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.518151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:14.527096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c079d686-119e-4681-b54e-35f5f29571f1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.096423 Sep 01 08:18:14.527700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 225/443] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:14 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:14.551927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:14.560911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0196b38b-21e4-4953-b33a-9ee99d6bc163 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096118 Sep 01 08:18:14.561483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 219/444] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:14 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:14.745994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:14.748158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:14.759264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.760139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.760938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.762209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:14.763191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:14.763943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:14.836507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:14.845451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-56b3c344-42e7-4b61-b805-ed9be0dc961f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.107044 Sep 01 08:18:14.846006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 226/445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:14 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:15.408167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:15.408776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:15.414894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.415609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.416263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.417119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.417703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.418278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.485753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:15.497155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:15.499655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:15.500824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9739301-75c6-4b95-a808-18b536ba77f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.096777 Sep 01 08:18:15.501387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 220/446] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:15 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:15.551085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:15.551689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:15.557866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.558373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.558806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.559493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.559935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.560346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.585802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:15.586724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:15.593060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.593637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.594590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.595379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.595909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.596586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.654447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:15.662902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3baa03dc-1d13-4ac9-8331-2d48bfa42f91 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.116326 Sep 01 08:18:15.663456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 227/447] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:15 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:15.675271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:15.687723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-242fea7c-4770-45c6-b417-f471ef810972 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.106485 Sep 01 08:18:15.688297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 221/448] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:15 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:15.867405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:15.867965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:15.874431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.874967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.875338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.876107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:15.876673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:15.877086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:15.939982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:15.947550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d9fe6741-d635-4ec4-8f4e-b9c94c5f0a61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085372 Sep 01 08:18:15.948161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 228/449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:15 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:16.523848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:16.524500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:16.530554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.531048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.531482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:16.532178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.532630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.533050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:16.595914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:16.604872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:16.606335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:16.607449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-00d09213-bcb6-4fea-a7f8-48b377211efa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087970 Sep 01 08:18:16.608042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 222/450] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:16 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:16.684344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:16.684958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:16.691816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.692298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.692715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:16.693402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.693839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.694252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:16.713923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:16.715086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:16.726086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.726531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.726970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:16.727660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.728097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.728514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:16.758441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:16.766213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3179f5f7-9ddc-4b37-b235-653b9750fa47 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085789 Sep 01 08:18:16.766807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 229/451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:16 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:16.791836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:16.799349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8ab56280-dfa2-44d5-890c-1436d11bc063 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.093648 Sep 01 08:18:16.799896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 223/452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:16 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:16.968845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:16.969716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:16.976053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.976581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.976964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:16.977669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:16.978109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:16.978564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:17.041060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:17.049178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dea439a2-b65f-4834-bb8a-ac0d58fa0560 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084242 Sep 01 08:18:17.049944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 230/453] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:16 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:17.631296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:17.631893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:17.638172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:17.638695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:17.639174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:17.639814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:17.640264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:17.640680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:17.701619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:17.709905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:17.711398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:17.712475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ab67ffee-ce46-4a4b-960f-13095109ad00 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085508 Sep 01 08:18:17.713019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 224/454] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:17 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:17.787972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:17.788566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:17.794841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:17.795316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:17.795753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:17.796422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:17.796865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:17.797280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:17.819565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:17.820162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:17.825959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:17.826460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:17.826888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:17.827562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:17.828001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:17.828411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:17.861486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:17.869097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61c9e282-0c17-4cf0-8e1d-8042630e24a8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085657 Sep 01 08:18:17.869654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 231/455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:17 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:17.892098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:17.900674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28f0d500-7528-4183-8f54-7f63fd4c23ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085358 Sep 01 08:18:17.901307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 225/456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:17 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:18.071036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:18.072133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:18.082378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.083283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.084034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.086716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.087219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.087643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.167930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:18.176866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e2f6d077-d589-44d8-9d69-c9d8499bd0e8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.111438 Sep 01 08:18:18.180613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 232/457] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:18 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:18.739698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:18.740312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:18.746230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.746754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.747187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.747881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.748321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.748744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.812437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:18.820990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:18.822428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:18.823510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-00fc99bb-f114-4ae3-930d-16fa9beb000f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088184 Sep 01 08:18:18.824050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 226/458] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:18 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:18.888765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:18.889358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:18.896359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.896859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.897280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.897963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.898438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.898847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.923347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:18.924362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:18.933713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.934238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.934751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.935796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:18.936336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:18.936847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:18.962666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:18.970552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e6579fe5-be15-416c-914d-ba7a88380036 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085505 Sep 01 08:18:18.971113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 233/459] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:18 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:19.000840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:19.009115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee80b957-27ee-4a28-b012-64712df300de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.091815 Sep 01 08:18:19.009670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 227/460] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:18 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:19.197639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:19.198178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:19.204573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:19.205058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:19.205488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:19.206189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:19.206717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:19.207153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:19.270640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:19.279309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47e4db57-6ddc-4354-9fcf-2e88773b6cf5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085778 Sep 01 08:18:19.280020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 234/461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:19 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:19.846701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:19.847303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:19.850899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:19.854660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:19.855141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:19.855570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:19.856255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:19.856695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:19.857106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:19.921020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:19.931449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:19.933219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:19.934392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4658e4f-33ad-4456-b802-2cdb1830f123 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091902 Sep 01 08:18:19.934966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 228/462] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:19 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:19.995784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:19.996747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:20.006375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.006882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.007323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:20.008345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.008802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.009228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:20.029093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:20.029699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:20.038496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.039323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.039939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:20.040833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.041281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.041698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:20.077041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:20.085559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-988679ba-9885-414f-a1ab-9432f148ddee tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.097683 Sep 01 08:18:20.086118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 235/463] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:19 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:20.111700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:20.119919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-646bdc1a-c9ce-411b-a821-838b44d76ec7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094713 Sep 01 08:18:20.120476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 229/464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:20 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:20.303406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:20.304006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:20.305855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:20.318907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.319529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.319966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:20.320941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.321405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.321954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:20.495833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:20.504617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cdb278e0-67ee-446d-871e-f04013a95925 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.205428 Sep 01 08:18:20.505100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 236/465] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:20 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:20.957453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:20.958065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:20.964825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.965298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.965721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:20.966436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:20.966888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:20.967297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:21.031778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:21.041683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:21.043155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:21.044277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f211f20c-0fbc-4f56-984e-640c7fc27824 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091383 Sep 01 08:18:21.044831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 230/466] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:20 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:21.108122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:21.108788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:21.115545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:21.116215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:21.116651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:21.117356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:21.117802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:21.118213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:21.143092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:21.144037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:21.150210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:21.150755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:21.151172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:21.151872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:21.152306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:21.152721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:21.184857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:21.193572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-140a0b6e-7b6e-4581-a391-8c566610eaeb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089354 Sep 01 08:18:21.194141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 237/467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:21 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:21.214440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:21.223497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1977a66c-fe2b-44a5-9af8-a35c7fef39ef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084127 Sep 01 08:18:21.224071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 231/468] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:21 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:21.525513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:21.526110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:21.532162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:21.532576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:21.533005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:21.533691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:21.534137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:21.534810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:21.606782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:21.614800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea653b29-6ca6-44b5-a8d1-a221f5f4132c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092991 Sep 01 08:18:21.615431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 238/469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:21 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:22.070128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:22.070714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:22.077543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.078023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.078682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.079802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.080550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.081262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.152377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:22.162412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:22.163864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:22.164993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aba29537-37b1-4289-b965-47c6a7c17de3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.100313 Sep 01 08:18:22.165563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 232/470] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:22 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:22.214595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:22.215194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:22.221410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.222442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.222869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.223557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.223991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.224403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.243541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:22.244095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:22.244892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:22.254782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.255401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.255905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.256599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.257135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.257621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.295729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:22.304599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7f1f413-561b-4b4b-acf6-3ed1f6d3ef76 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.093910 Sep 01 08:18:22.305176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 239/471] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:22 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:22.324056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:22.332840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb5dc888-b265-43de-8d21-cc489835dc6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092666 Sep 01 08:18:22.333797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 233/472] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:22 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:22.636473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:22.637897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:22.645399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.645907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.646504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.647102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:22.647591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:22.648013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:22.714636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:22.727067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c6b06638-cd70-4438-8952-433150f0977d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.094146 Sep 01 08:18:22.727810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 240/473] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:22 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:23.191231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:23.192153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:23.207908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.208950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.209403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.210275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.210735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.211158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.277522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:23.281158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:23.287259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:23.288689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:23.289799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1464c799-8268-4cd6-9e2c-0aacfe9e6a2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.104540 Sep 01 08:18:23.290370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 234/474] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:23 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:23.326806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:23.327417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:23.333831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.334345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.334789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.335480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.335935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.336357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.354598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:23.355205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:23.361757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.362794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.363469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.364389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.364840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.365262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.405686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:23.415781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52967e48-7d1b-4133-b3c8-ff0c304db951 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.092714 Sep 01 08:18:23.416362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 241/475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:23 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:23.433907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:23.449576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-529ed49c-fe02-4b93-bc4d-d58b203ef945 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.098581 Sep 01 08:18:23.450244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 235/476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:23 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:23.748330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:23.749013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:23.755465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.755960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.756420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.757137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:23.757582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:23.758055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:23.819624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:23.827363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-83184515-1759-42fc-8502-6d073a9f77ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083396 Sep 01 08:18:23.827958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 242/477] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:23 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:24.312878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:24.313489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:24.323159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.323800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.324248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.324982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.325428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.325841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.390975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:24.400801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:24.402248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:24.403379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-33b2ae6a-b5db-41c2-9e82-15da1e05f6c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094556 Sep 01 08:18:24.404113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 236/478] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:24 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:24.437935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:24.438567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:24.445399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.445876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.446328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.447020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.447465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.447900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.473594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:24.474216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:24.480244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.480907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.481519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.482421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.482876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.483480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.544766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:24.552436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-806b31a9-39c7-4d7b-a048-f3ba473677df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.118408 Sep 01 08:18:24.552988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 243/479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:24 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:24.561088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:24.569325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-87820a38-2ff5-4f72-b0ce-815b3263039e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.099950 Sep 01 08:18:24.569867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 237/480] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:24 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:24.852709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:24.853318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:24.859226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.859703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.860141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.860806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:24.861248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:24.861658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:24.925476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:24.933497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b7dd637b-9f02-413f-a8b8-eb521459eef5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084649 Sep 01 08:18:24.934078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 244/481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:24 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:25.426518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:25.427176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:25.433237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.433749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.434185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:25.434912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.435361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.435787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:25.500306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:25.510109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:25.511582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:25.512688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46976749-ae4f-43cd-a7f7-eb66de5f4e1d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090208 Sep 01 08:18:25.518306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 238/482] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:25 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:25.573402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:25.574122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:25.587824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.588324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.588757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:25.589460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.589910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.590363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:25.593359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:25.594241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:25.600356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.600832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.601261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:25.601941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.602420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.602840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:25.662164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:25.669729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-70e0c32c-68ce-4633-a333-de8f1ebce67d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.100882 Sep 01 08:18:25.670310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 245/483] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:25 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:25.682097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:25.689661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8793cdfb-9a7c-492f-9d14-08e772aeccbc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.100882 Sep 01 08:18:25.690210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 239/484] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:25 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:25.955350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:25.956119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:25.962800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.963305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.963734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:25.964447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:25.964982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:25.965365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:26.029880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:26.038164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f52b1e59-7f13-40ee-a45a-b72a10faf99c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086721 Sep 01 08:18:26.038767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 246/485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:25 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:26.548096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:26.548708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:26.556333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:26.557026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:26.557498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:26.558413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:26.558935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:26.559366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:26.623513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:26.632655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:26.634089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:26.635225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1679ac2a-b43b-4adc-80e5-d08455f41af3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091116 Sep 01 08:18:26.635778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 240/486] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:26 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:26.692661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:26.693309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:26.699166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:26.699637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:26.700062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:26.700730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:26.701175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:26.701589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:26.710588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:26.711196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:26.717057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:26.717537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:26.717970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:26.718961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:26.719414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:26.719837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:26.773613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:26.781546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3df38fc-c456-4d19-ae4f-97b542a11fdf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.092647 Sep 01 08:18:26.782101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 247/487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:26 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:26.794049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:26.802046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-217cefe0-e902-4ff8-a20c-200f2a620880 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.095290 Sep 01 08:18:26.802638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 241/488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:26 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:27.060309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:27.060913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:27.067261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.067745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.068171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.068855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.069308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.069810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.134770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:27.146561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-df447612-853f-40bc-98a9-28edab6cdce5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089975 Sep 01 08:18:27.147137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 248/489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:27 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:27.658468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:27.659909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:27.666419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.666903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.667330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.668013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.668458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.668869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.729748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:27.738602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:27.740300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:27.741892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-abce1df7-18f5-4d67-b735-732df4a44917 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088429 Sep 01 08:18:27.742548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 242/490] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:27 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:27.802072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:27.802689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:27.808535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.808986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.809404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.810102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.810576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.810986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.822175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:27.822814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:27.828807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.829292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.829757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.830477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:27.831450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:27.831866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:27.874839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:27.882828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-caba3217-c569-4923-b427-7408982a154e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084567 Sep 01 08:18:27.883386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 249/491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:27 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:27.903016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:27.911131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a88cbde9-1df2-4673-81a7-aa085f16de63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092782 Sep 01 08:18:27.911687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 243/492] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:27 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:28.169099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:28.169099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:28.180500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.181503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.182402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.183778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.184632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.185133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.263532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:28.271791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-795afe7a-40a3-4477-88cc-44e5b391f83e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.108405 Sep 01 08:18:28.272345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 250/493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:28 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:28.769515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:28.770225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:28.776021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.776489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.776919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.777586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.778026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.778666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.841008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:28.854140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:28.855841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:28.857204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93b573ce-2426-4a63-a210-5af7c8c81f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091791 Sep 01 08:18:28.857961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 244/494] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:28 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:28.903980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:28.904607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:28.910811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.911271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.911696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.912376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.912824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.913239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.931821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:28.932542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:28.938527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.939021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.939465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.940799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:28.941264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:28.941896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:28.978204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:28.985936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-798fac23-fedb-4f71-9e92-2154c81ca082 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085750 Sep 01 08:18:28.986667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 251/495] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:28 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:29.008449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:29.015956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46ea8b8b-7fdf-47ba-acc1-7d83197c3399 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088332 Sep 01 08:18:29.016503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 245/496] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:28 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:29.292338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:29.292937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:29.298896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:29.299374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:29.300396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:29.301308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:29.301760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:29.302176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:29.362651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:29.370242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6c923f59-a9bf-48c1-8f4d-13393cde8c0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081670 Sep 01 08:18:29.371436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 252/497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:29 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:29.881320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:29.881852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:29.888106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:29.888579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:29.889004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:29.889673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:29.890119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:29.890563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:29.951204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:29.960410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:29.962039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:29.963859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-27e18cf6-f57c-4740-b622-870ee61f3643 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086562 Sep 01 08:18:29.963859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 246/498] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:29 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:30.007480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:30.008293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:30.014737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.015437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.015653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:30.016594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.017173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.017665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:30.039716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:30.040322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:30.046131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.046641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.047073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:30.047755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.048202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.048774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:30.082358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:30.089895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-522e0a69-5f50-48ea-b65f-492d7f7d7318 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086986 Sep 01 08:18:30.090558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 253/499] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:30 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:30.113818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:30.121651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fd510d2b-c709-498e-badf-7bf98540bea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085663 Sep 01 08:18:30.122214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 247/500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:30 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:30.393167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:30.394173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:30.399834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.400307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.400729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:30.401411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.401848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.402278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:30.466706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:30.480654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3d62b1ba-390a-4d6d-a231-a94fd33a80be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090894 Sep 01 08:18:30.482561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 254/501] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:30 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:30.990211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:30.990831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:30.996717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.997190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.997620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:30.998317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:30.998769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:30.999186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:31.063539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:31.072318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:31.073676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:31.074819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eebae25c-8cea-4f7d-94d4-fab5a9a3f895 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088531 Sep 01 08:18:31.075373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 248/502] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:30 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:31.111298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:31.111898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:31.117900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:31.118428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:31.118861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:31.119543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:31.119992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:31.120407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:31.141043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:31.141654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:31.149219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:31.149723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:31.150150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:31.150880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:31.151321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:31.151738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:31.184181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:31.192401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3b5941cd-6584-4d78-8ff9-2bc5a29bb0ba tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084863 Sep 01 08:18:31.192972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 255/503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:31 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:31.214146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:31.222941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd3be91b-876c-4826-b62a-c7259455023a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085589 Sep 01 08:18:31.223498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 249/504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:31 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:31.502578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:31.503937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:31.510894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:31.511379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:31.511813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:31.512510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:31.512962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:31.513380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:31.517656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:31.578748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:31.587763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b9b07422-af12-47d2-989e-d6a1d3ec6545 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088693 Sep 01 08:18:31.588119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 256/505] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:31 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:32.098931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:32.099529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:32.105453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.105932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.106463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.107148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.107593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.108014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.176479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:32.184720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:32.186142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:32.187270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b62bdba8-ab5a-4e53-8d4b-eff52b3a48b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092739 Sep 01 08:18:32.187813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 250/506] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:32 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:32.213002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:32.213607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:32.219865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.220350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.220788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.222037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.222913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.223319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.244902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:32.245514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:32.251710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.252196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.253253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.254026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.255215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.255657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.274334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:32.287910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:32.297180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5c05af21-cfc2-4e54-bbab-bc272383cb55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087810 Sep 01 08:18:32.298248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 257/507] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:32 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:32.326243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:32.333984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5e37797a-650a-492c-a199-05021adf6c11 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092903 Sep 01 08:18:32.334737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 251/508] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:32 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:32.608685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:32.609294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:32.616155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.616644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.617080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.617774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:32.618223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:32.618682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:32.704240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:32.713705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a571452d-67a4-4085-890a-89b2de382372 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.108777 Sep 01 08:18:32.714511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 258/509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:32 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:33.210654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:33.211225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:33.217149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.217637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.218077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.219224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.219681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.220588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.287073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:33.295189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:33.296635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:33.297738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d94908ac-2070-4ed4-a5db-c0dc050abb42 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091963 Sep 01 08:18:33.298301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 252/510] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:33 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:33.320939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:33.321536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:33.327660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.328132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.328572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.329238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.329681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.330093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.358287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:33.358896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:33.365263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.365744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.366181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.368492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.369079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.369886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.421048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:33.429687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7f84a8e-5537-4b8a-9fdd-4d57a6e8ae50 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.113000 Sep 01 08:18:33.438339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 259/511] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:33 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:33.452719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:33.462749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2daf58a1-ded8-4bd4-aa25-8e4398e7860c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.108106 Sep 01 08:18:33.463306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 253/512] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:33 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:33.742741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:33.743507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:33.749143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.749615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.750062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.750795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:33.751250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:33.751671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:33.832949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:33.841755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18c9a8e1-ce51-4ff4-b755-5b052059bcdb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.102874 Sep 01 08:18:33.842608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 260/513] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:33 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:34.322224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:34.322917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:34.328791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.329320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.329748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.330480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.331775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.332199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.395968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:34.404478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:34.405912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:34.407052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed78abdf-37df-46ec-842e-5ce6d937bac4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089280 Sep 01 08:18:34.407608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 254/514] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:34 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:34.453023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:34.453674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:34.460717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.461208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.461638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.462545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.463082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.463407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.486171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:34.486809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:34.493503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.494007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.494435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.495118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.495559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.495975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.539067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:34.547796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-78357300-3728-4aa6-871f-d1cb38991226 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.098647 Sep 01 08:18:34.548543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 261/515] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:34 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:34.571967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:34.579990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d6426288-0eb8-4c97-84fe-72ad5049c3ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097603 Sep 01 08:18:34.580590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 255/516] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:34 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:34.865489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:34.866074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:34.872082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.872560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.872993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.873683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:34.874139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:34.874606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:34.942029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:34.951446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7eba3bcc-c322-4ddd-a76c-8f8e106f769e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090903 Sep 01 08:18:34.952041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 262/517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:34 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:35.429817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:35.430457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:35.436618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.437096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.437522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:35.438210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.438689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.439104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:35.507970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:35.516821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:35.519141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:35.520249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-53527d07-37b9-415e-b264-668112a3b5f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094298 Sep 01 08:18:35.520791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 256/518] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:35 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:35.570058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:35.570777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:35.576806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.577280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.577874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:35.578760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.579202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.579879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:35.600994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:35.601633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:35.607651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.608280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.608727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:35.609539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.609997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.610749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:35.647492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:35.655295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24089b40-2020-4d26-bc2f-9fced249e9e8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089086 Sep 01 08:18:35.656075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 263/519] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:35 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:35.679333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:35.687364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9cd9284-ae58-44c3-a73f-20185269eb30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.090776 Sep 01 08:18:35.687862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 257/520] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:35 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:35.973041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:35.973558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:35.980392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.981067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.981575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:35.982570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:35.983175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:35.983599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:36.045976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:36.054178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a92922ca-876a-4e31-84c4-dfb75cfdbac6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085887 Sep 01 08:18:36.054794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 264/521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:35 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:36.543271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:36.543876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:36.549822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:36.550334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:36.551176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:36.551886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:36.552331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:36.552752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:36.619332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:36.628149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:36.630687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:36.631401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-676e81de-3e53-4f04-b179-6b55ca08133b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091916 Sep 01 08:18:36.632277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 258/522] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:36 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:36.681702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:36.681702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:36.684699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:36.685181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:36.685604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:36.686311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:36.686758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:36.687170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:36.708527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:36.709203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:36.715811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:36.716287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:36.716714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:36.717392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:36.717835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:36.718251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:36.749274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:36.758044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-beb41f55-4b90-41de-8989-a9617b829180 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084633 Sep 01 08:18:36.758643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 265/523] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:36 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:36.782037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:36.789718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4c2312e5-94c2-4adf-93b5-7d9863b510f3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085481 Sep 01 08:18:36.790500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 259/524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:36 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:37.085009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:37.085661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:37.091703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.092188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.092622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.093584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.094067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.094504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.156916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:37.168005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e88e0cb7-de1c-43f1-972a-6dcbbbb25087 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086678 Sep 01 08:18:37.168910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 266/525] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:37 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:37.654863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:37.655472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:37.661975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.662376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.662805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.663497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.663974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.664397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.735953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:37.745461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:37.746937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:37.748039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ef220e8e-5d02-42aa-bb60-91a41e387c4b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.097034 Sep 01 08:18:37.748596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 260/526] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:37 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:37.778598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:37.779205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:37.785526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.786078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.786544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.787220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.787665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.788079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.810909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:37.811511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:37.817801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.818363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.818796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.819484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:37.819927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:37.820342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:37.849382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:37.857021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75a263fa-2829-45d5-a7fa-974c8243a0df tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082278 Sep 01 08:18:37.857568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 267/527] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:37 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:37.895217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:37.902821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61544665-a9f6-43a8-a7dc-f32421370345 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.095979 Sep 01 08:18:37.903378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 261/528] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:37 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:38.190542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:38.191140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:38.198205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.198711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.199144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.199836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.200286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.200709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.270305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:38.278547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b21dbd9-ca69-4193-bbec-90d9bdc6f893 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.091785 Sep 01 08:18:38.279119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 268/529] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:38 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:38.771511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:38.772121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:38.778073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.778594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.779029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.779823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.780297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.780712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.848619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:38.856859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:38.858302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:38.859406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31f66116-84e2-455e-9c62-81830fbf659f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091962 Sep 01 08:18:38.859959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 262/530] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:38 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:38.878238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:38.879485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:38.885316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.885791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.886219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.886925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.887371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.887804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.923585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:38.924189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:38.930893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.931376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.931802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.932487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:38.932937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:38.933350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:38.953360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:38.963799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c522e003-16a6-4a27-af19-c3bae2dc909b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089268 Sep 01 08:18:38.964808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 269/531] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:38 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:39.013275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:39.022472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f4d947d0-b62a-4854-a78b-40aa804fbb57 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.102511 Sep 01 08:18:39.023042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 263/532] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:38 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:39.300140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:39.300795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:39.307712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:39.308196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:39.308626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:39.309322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:39.309770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:39.310188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:39.376734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:39.392847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2c8295df-fedc-42f7-9d54-1ffa3ca95031 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.096480 Sep 01 08:18:39.393695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 270/533] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:39 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:39.883343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:39.884619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:39.890734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:39.891217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:39.891645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:39.892342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:39.892791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:39.893207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:39.964038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:39.973473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:39.975036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:39.976539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e2022168-5dbc-4f51-a95b-debcf6d015dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.097418 Sep 01 08:18:39.977233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 264/534] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:39 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:39.986889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:39.987543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:39.995904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:39.996454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:39.996953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:39.997710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:39.998245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:39.998767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:40.044199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:40.044866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:40.051044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:40.052757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:40.053211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:40.053917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:40.054404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:40.054821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:40.076177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:40.084243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f0ec0cf8-7730-4f31-bdfe-b607d8b6c8a7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.101228 Sep 01 08:18:40.099242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 271/535] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:39 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:40.129341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:40.137452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-17c397f3-ae24-4ebe-b9f3-789301bccefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097278 Sep 01 08:18:40.138077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 265/536] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:40 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:40.418390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:40.419036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:40.425450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:40.425931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:40.426430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:40.427340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:40.427688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:40.428109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:40.492203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:40.495529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:40.499972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a1f12067-5a61-4ea9-aca0-d861aa61ddb9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085519 Sep 01 08:18:40.500538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 272/537] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:40 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:41.000563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:41.001283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:41.007346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.007825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.008262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.008953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.009400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.009817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.075330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:41.089417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:41.090913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:41.092163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d3801f38-0b92-49fc-9af1-bb95a94deb5e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095430 Sep 01 08:18:41.092718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 266/538] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:40 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:41.106187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:41.106884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:41.113324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.113885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.114893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.115561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.116004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.116413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.158667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:41.159272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:41.165848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.166515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.166943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.167624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.168099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.168514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.175965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:41.183417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-974a57ae-78ca-47bb-9dd0-b41b2411b83c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081054 Sep 01 08:18:41.183971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 273/539] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:41 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:41.233201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:41.240882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5aa404e3-c93f-4f9e-abb1-9fb2d5c5ecef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085932 Sep 01 08:18:41.242923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 267/540] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:41 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:41.523712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:41.526125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:41.537235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.537827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.538494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.539347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:41.539901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:41.540413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:41.726604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:41.736305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3834d4e7-afd1-468f-bc18-78ac6c5ddff9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.217410 Sep 01 08:18:41.737065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 274/541] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:41 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:42.120716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:42.122047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:42.133523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.134425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.135176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.136367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.137263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.138017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.145685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:42.207290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:42.208523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:42.212114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:42.223278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:42.224713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:42.226309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.226494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15e30a0c-90bc-48f4-b0eb-95e27b2e5ff0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.113882 Sep 01 08:18:42.227598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 268/542] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:42 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:42.251925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.252670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.253520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.253978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.254565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.263758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:42.264549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:42.271852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.272581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.273124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.274122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.274602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.275021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.327430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:42.335611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-31d680bf-239e-4ebe-b776-08986fe6d2e6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.136148 Sep 01 08:18:42.336179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 275/543] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:42 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:42.348091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:42.356414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-20218fc3-019f-4619-a523-5a34657f88b0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096584 Sep 01 08:18:42.356968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 269/544] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:42 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:42.759010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:42.759642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:42.765823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.766340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.766775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.767467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:42.767912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:42.768328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:42.834688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:42.843076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b0ad693c-a83e-4306-bd83-9bf63c9b1d37 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087733 Sep 01 08:18:42.844066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 276/545] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:42 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:43.261262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:43.262625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:43.269054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.269585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.270023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.270980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.271518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.271938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.341257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:43.350570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:43.352031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:43.353119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fea64ef3-2c7d-403f-88e2-ad6dc3f4f75f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095713 Sep 01 08:18:43.353679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 270/546] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:43 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:43.356644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:43.357246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:43.363125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.363598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.364616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.365301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.365749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.366157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.376747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:43.377347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:43.383272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.383748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.384177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.384862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.385309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.385728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.429271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:43.436946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-11647f3d-5093-4b45-a66a-be313c3f932c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083985 Sep 01 08:18:43.437742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 277/547] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:43 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:43.456071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:43.463702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3542069c-044e-4c3f-b9db-5229d31450da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.090682 Sep 01 08:18:43.464256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 271/548] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:43 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:43.865424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:43.866024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:43.873247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.873730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.874487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.875737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:43.876210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:43.876666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:43.945084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:43.953147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9c399991-4ef6-4cb4-baaa-a498dabb0f78 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.091788 Sep 01 08:18:43.953715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 278/549] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:43 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:44.375893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:44.376492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:44.382621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.383102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.383530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:44.384217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.384657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.385070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:44.446765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:44.454795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:44.456214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:44.457300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7bc8b00f-a999-401c-b89f-4382e9549bc1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085242 Sep 01 08:18:44.458012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 272/550] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:44 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:44.459110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:44.459722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:44.465656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.466142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.466708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:44.467302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.467752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.468441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:44.484382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:44.484984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:44.491349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.491835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.492268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:44.492953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.493402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.493823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:44.531803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:44.540422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-844ed72f-8fc4-44fe-a57b-0a3ceea8895e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085224 Sep 01 08:18:44.541084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 279/551] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:44 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:44.557989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:44.566721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3249a17b-a4b6-4f5d-8b4c-d21185c78f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086074 Sep 01 08:18:44.567440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 273/552] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:44 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:44.984796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:44.985422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:44.992171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.992653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.993075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:44.993771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:44.994217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:44.994663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:45.064855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:45.073226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-561d3be6-43cc-4e36-9e5c-69b6d0b003db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092143 Sep 01 08:18:45.073798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 280/553] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:44 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:45.481266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:45.482449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:45.489743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:45.490523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:45.490955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:45.491651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:45.492088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:45.492501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:45.559619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:45.561878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:45.562509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:45.568523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:45.569070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:45.569546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:45.570002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:45.570153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:45.570837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:45.571388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:45.571538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1c60691f-687a-4459-b8ff-5992e1af639e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095140 Sep 01 08:18:45.571854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:45.572278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 274/554] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:45 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:45.587844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:45.589541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:45.596068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:45.596630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:45.597131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:45.597927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:45.598679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:45.599107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:45.638367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:45.649297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b62e57d9-5c05-4329-b114-089de478e876 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.091341 Sep 01 08:18:45.650095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 281/555] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:45 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:45.668203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:45.675999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7766cffc-34ed-40d6-ba22-20bb940eddae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092237 Sep 01 08:18:45.677130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 275/556] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:45 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:46.096040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:46.096588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:46.103421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.103900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.104323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.105007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.105448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.105858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.172476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:46.185390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61cbc240-e09d-412c-bc6c-8ed62d510e1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093754 Sep 01 08:18:46.186369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 282/557] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:46 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:46.598317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:46.599674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:46.606312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.606710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.607138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.607839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.608358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.608677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.670199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:46.671027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:46.678041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.679557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.680680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.681808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.682384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.682886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.755310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:46.764313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c315f99e-5b0d-4e12-9149-116f101560de tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.098056 Sep 01 08:18:46.778665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 283/558] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:46 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:46.778665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:46.778665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:46.778665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.778665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.779167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.779850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:46.780366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:46.780886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:46.829037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:46.838528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:46.839586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:46.840702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2463c8c9-b586-46e0-a913-762a46961244 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.248063 Sep 01 08:18:46.841266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 276/559] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:46 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:46.857534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:46.866156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03ddce15-b786-41bc-bd5d-01a11bdbb9ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.099803 Sep 01 08:18:46.866829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 284/560] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:46 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:47.214171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:47.215536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:47.226525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.227182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.227933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:47.228583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.229227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.229702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:47.354752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:47.364896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3e5b480b-36da-4447-8760-106b0047580d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.155475 Sep 01 08:18:47.365767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 277/561] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:47 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:47.787836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:47.788707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:47.796672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.798481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.800468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:47.801218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.802011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.802489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:47.864738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:47.866080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:47.877448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:47.879461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:47.880963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.886429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.889690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:47.890465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.891095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.891688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:47.906489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d36e4ee9-c87f-4b26-b479-6e8a5323e525 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.113878 Sep 01 08:18:47.906489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 285/562] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:47 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:47.906489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:47.906489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:47.906489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:47.910790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.911217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.911652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:47.912351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:47.912800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:47.913255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:48.029553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:48.041448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-45093beb-674e-46a1-b5dd-1e691b3501cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.143160 Sep 01 08:18:48.043294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 286/563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:47 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:48.060235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:48.070961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:48.072387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:48.073490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c67e63bf-c439-4644-9f73-8cace7bfddbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.212962 Sep 01 08:18:48.074219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 278/564] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:47 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:48.388340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:48.388957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:48.395370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:48.396175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:48.396846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:48.398674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:48.399237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:48.399909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:48.496036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:48.504256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1bb16138-1ee3-4161-a882-c9ee3e7319d3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.119761 Sep 01 08:18:48.505081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 287/565] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:48 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:48.921527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:48.922284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:48.929684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:48.930422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:48.930422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:48.931147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:48.931665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:48.932187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:49.016928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:49.025245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1d678e30-98f8-49f0-813a-aa44aae353e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.107511 Sep 01 08:18:49.025918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 279/566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:48 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:49.065318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:49.065934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:49.072329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:49.072820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:49.073250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:49.073945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:49.074426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:49.074843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:49.097139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:49.097740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:49.104553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:49.105106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:49.105753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:49.106858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:49.107797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:49.108493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:49.153193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:49.166282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75bf913b-4838-46d8-a40d-7912248c2c2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.105338 Sep 01 08:18:49.184685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 288/567] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:49 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:49.209799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:49.222710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:49.224568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:49.226301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-659453ab-1087-4c68-9094-b683530d5bc6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.132837 Sep 01 08:18:49.241735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 280/568] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:49 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:49.534612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:49.535350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:49.543597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:49.544518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:49.545788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:49.546981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:49.547565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:49.548275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:49.571774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:49.656990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:49.676993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee457c25-a21b-4093-aea5-f58587c280a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.152690 Sep 01 08:18:49.678380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 289/569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:49 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:50.046326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:50.047094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:50.052972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.053454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.053945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.055022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.055481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.055909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.132023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:50.142886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f9254646-a282-46c4-941b-7ff88121dec9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.100392 Sep 01 08:18:50.143441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 281/570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:50 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:50.188119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:50.188738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:50.197727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.198515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.199292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.200261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.200961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.201731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.250792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:50.251505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:50.262662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.263148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.263577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.264277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.264968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.265377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.284443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:50.293927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40bb6bc0-c2bd-4d8e-a4d6-e32b3cabf03f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.109748 Sep 01 08:18:50.294600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 290/571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:50 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:50.338839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:50.348363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:50.349982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:50.351371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2b44a71a-6a8e-4324-ad2f-84d2b48248d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.105049 Sep 01 08:18:50.351923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 282/572] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:50 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:50.699491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:50.700110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:50.706287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.706807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.707231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.707926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:50.708387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:50.708806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:50.774850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:50.783390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-da47d226-d11b-40a5-bfda-2dbd7e2f4c5c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088403 Sep 01 08:18:50.784243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 291/573] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:50 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:51.164232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:51.164946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:51.172004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.172723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.173151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.173838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.174301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.174754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.248302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:51.255826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09aecdf5-8dd3-441f-af31-80c6d8eb4905 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.096092 Sep 01 08:18:51.256373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 283/574] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:51 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:51.316631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:51.317447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:51.325071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.325794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.326395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.327173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.327622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.328037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.376910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:51.378399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:51.386533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.387832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.388487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.389467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.389886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.390401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.418656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:51.427956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c8e63079-7eb8-4d77-872c-900aebb32594 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.115254 Sep 01 08:18:51.434517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 292/575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:51 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:51.469056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:51.473462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:51.486857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:51.488291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:51.489394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-386befc4-5681-437d-ae37-5e9254719f90 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.117557 Sep 01 08:18:51.489939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 284/576] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:51 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:51.527367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-858368332", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "networks": [{"uuid": "aab87eba-4a49-4163-b9bf-842b83e94ed8"}]}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:18:51.600336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] validate_networks() for [('aab87eba-4a49-4163-b9bf-842b83e94ed8', None, None, None, None, None)] {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:18:51.812007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:51.812623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:51.819030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.819519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.819955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.820654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:51.821101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:51.821530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:51.957752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:51.966757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a92ad6c-ce7c-4cdd-87cd-ceab6f55022e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.158574 Sep 01 08:18:51.967332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 285/577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:51 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:52.119075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:18:52.119581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:18:52.120132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:18:52.121052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:18:52.121596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:18:52.132800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.133043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.133866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.134197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.135132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.135787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.162418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Getting quotas for project 82d7e2503aa043929798769c22c1b2da. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:18:52.169317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Getting quotas for user d713712c30574895b82beedb9c4f251d and project 82d7e2503aa043929798769c22c1b2da. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:18:52.184425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:18:52.187569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:18:52.239948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-543ad643-294f-469f-b006-5598e01e9f91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718855 Sep 01 08:18:52.241114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 293/578] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:18:52.256482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9448d48e-30f4-471c-a4ee-9316df8eb9a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:52.257653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9448d48e-30f4-471c-a4ee-9316df8eb9a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:52.279423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:52.280138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:52.289679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.294651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.299326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.300180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.300660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.301096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.339514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9448d48e-30f4-471c-a4ee-9316df8eb9a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:52.349077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9448d48e-30f4-471c-a4ee-9316df8eb9a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1218 microversion: 2.1 time: 0.094661 Sep 01 08:18:52.359017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 286/579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:52 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:52.399199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:52.406842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7111eaa1-3d1b-4fc7-ab33-597e150dbbff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.131951 Sep 01 08:18:52.407619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 294/580] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:52 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:52.449989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:52.450866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:52.458160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.458670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.459099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.459782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.460883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.461332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.513896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:52.514886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:52.521223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.521856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.522425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.523125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:52.524193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:52.525209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:52.554533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:52.564367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-92c56cd3-a52f-4712-9870-4bf86173ec55 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.118473 Sep 01 08:18:52.582676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 287/581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:52 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:52.599928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:52.609948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:52.611762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:52.613077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-01cc38a7-080d-4463-b992-58905f1ba2b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.103371 Sep 01 08:18:52.613811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 295/582] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:52 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:52.999330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:53.000940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:53.010117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.010937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.011375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.012142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.012603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.013027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.097958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:53.108848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46c82970-e05b-4eda-ba55-9f7a383f0b4b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.116914 Sep 01 08:18:53.109883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 288/583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:52 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:53.370071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:53.371251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:53.378301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.379133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.379735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.380429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.380875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.381286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.428942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:53.430417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:53.436282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.442247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.442871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.443809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.444838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.445648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.480093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:53.500334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16d05f40-09fa-4ce0-bd64-8ac66b0cad5f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.134866 Sep 01 08:18:53.501302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 296/584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:53 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:53.527774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:53.536534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1dbb6c52-d049-4094-a1a8-840a4b3f07d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.112254 Sep 01 08:18:53.537111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 289/585] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:53 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:53.593773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:53.595200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:53.608215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.609353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.610832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.612379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.613892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.614923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.642549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:53.643473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:53.651286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.651767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.652199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.653044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:53.653650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:53.654241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:53.739695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:53.749446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c73c0696-cccd-4a6a-bf3b-4be28ca64a8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.164392 Sep 01 08:18:53.750135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 297/586] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:53 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:53.765608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:53.775429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:53.776857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:53.777968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b812ec14-dee8-4488-a4c1-ce689e2ed3b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.140157 Sep 01 08:18:53.778854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 290/587] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:53 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:18:54.140167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:54.141663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:54.149330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.150067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.150818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.151376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.151829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.152548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.243807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:54.253896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d4ae4c6f-e389-42e7-8899-cbd188b85a16 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.125956 Sep 01 08:18:54.254507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 298/588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:54 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:54.525878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:54.527316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:54.535146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.536228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.537006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.538980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.539668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.540376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.565932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:54.567522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:54.579373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.580533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.582687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.584163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.585715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.588662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.631606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:54.644037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a581a9f-5342-4f36-87f8-6906218db1f1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.123997 Sep 01 08:18:54.644869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 291/589] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:54 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:54.672547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:54.681297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ccd96ab3-f70f-4966-9f9d-3265f412a425 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.123680 Sep 01 08:18:54.681982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 299/590] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:54 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:54.773192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:54.774425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:54.784540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.785595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.786227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.787239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.787967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.788841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.803394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:54.804928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:54.813114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.814393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.815084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.816178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:54.816848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:54.817483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:54.923987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:54.939993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31a7775e-287a-4267-9cc5-56240f09a28d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.169915 Sep 01 08:18:54.941448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:54.953430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 292/591] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:54 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:54.962351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:54.963900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:54.965164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc20a7be-9e02-4dc9-927a-0b2f6a992c35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.167899 Sep 01 08:18:54.965803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 300/592] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:54 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:55.276314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:55.277150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:55.306814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.307310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.307757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:55.309971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.310481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.310908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:55.388851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:55.405167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f9b1bbed-9574-4b61-b9fc-66a228dabffd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.133605 Sep 01 08:18:55.406027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 293/593] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:55 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:55.665122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:55.666047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:55.672412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.672902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.673434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:55.674151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.674711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.675115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:55.706629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:55.709185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:55.721319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.722668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.723536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:55.724755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.726151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.726995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:55.820518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:55.831562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d08bed6-dfe3-45de-8ad4-5404e15dfc1c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.131722 Sep 01 08:18:55.832852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 294/594] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:55 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:55.893886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:55.904856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d2036653-1ab7-46cc-8169-92b84bee27ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.243560 Sep 01 08:18:55.905879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 301/595] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:55 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:55.966228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:55.967352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:55.974598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.975312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.975855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:55.976792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:55.977460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:55.978139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.008849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:56.009867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:56.017604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.019989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.021421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.021421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.023999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.035831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.106419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:56.115251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b47a811-985c-4e02-b004-17f136416947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.153358 Sep 01 08:18:56.115812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 295/596] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:55 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:56.130900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:56.141753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:56.143405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:56.144499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8b581ffc-49a8-4501-ad74-b031d66fc770 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.141695 Sep 01 08:18:56.145046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 302/597] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:56 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:56.426838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:56.427453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:56.437960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.437960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.437960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.437960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.438441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.438441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.506932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:56.515215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9c02a3fa-49e7-4481-bc92-c60c826bf1b7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092235 Sep 01 08:18:56.515984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 296/598] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:56 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:56.854697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:56.855275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:56.861146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.861623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.862055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.862770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.863217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.863636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.924061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:56.926107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:56.926816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:56.931687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1a34feba-b3c5-405a-ba30-a8d849810953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081481 Sep 01 08:18:56.932244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 303/599] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:56 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:56.933116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.933592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.934021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.934728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:56.935171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:56.935585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:56.995980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:57.003598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e81b255-80b2-468e-b769-99a7015ebe12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081438 Sep 01 08:18:57.004146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 297/600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:56 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:57.143417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:57.143953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:57.150955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.151456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.151878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:57.152579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.153034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.153455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:57.167752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:57.168358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:57.174457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.174949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.175384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:57.176072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.176519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.176936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:57.227403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:57.235128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e95c6310-2676-4227-b574-fcf456a208de tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.095516 Sep 01 08:18:57.235704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 304/601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:57 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:57.247797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:57.255925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:57.257923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:57.259041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f65bdd4-a64b-4907-840d-d955bedc6fa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.096033 Sep 01 08:18:57.259585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 298/602] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:57 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:57.537169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:57.537763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:57.544140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.544615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.545038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:57.545718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.546159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.546592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:57.614045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:57.622804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-373fde85-1271-48e0-9e11-b8661739f4de tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089323 Sep 01 08:18:57.623381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 305/603] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:57 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:57.952383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:57.952898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:57.958779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.959255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.959822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:57.960657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:57.961126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:57.961560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.021419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:58.024843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:58.025455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:58.029495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4825348a-f867-4a43-b92b-a48c168ef456 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.080989 Sep 01 08:18:58.030057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 299/604] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:57 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:58.031574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.031968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.032282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.033150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.033603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.034023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.098821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:58.102713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:58.107920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2a72a275-b431-49b6-bd0e-92e001aee300 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087041 Sep 01 08:18:58.108531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 306/605] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:58 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:58.255439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:58.255950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:58.262183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.262704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.263129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.263814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.264259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.264668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.284824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:58.284824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:58.291951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.292430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.292923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.293556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.294007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.294460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.436452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:58.448787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a7d7a02-149e-4edc-9565-64c7aa76d2d4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.196967 Sep 01 08:18:58.449442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 300/606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:58 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:58.465362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:58.476208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:58.476876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:58.478028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-142e642a-702c-4a43-abbd-4aa16fe0e196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.197779 Sep 01 08:18:58.478659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 307/607] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:58 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:58.642605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:58.643203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:58.649148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.649655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.650082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.650790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:58.651233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:58.651645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:58.713746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:58.722663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fdfabd09-5d3c-41a6-bdcf-ae6de0864064 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083760 Sep 01 08:18:58.723238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 301/608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:58 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:59.051432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:59.052036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:59.058031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.058545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.058971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.059652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.060095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.060510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.121123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:59.128626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6028a4e3-e1d6-4e09-a60b-80b183cd4c1e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081017 Sep 01 08:18:59.129186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 308/609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:59 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:59.133386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:59.133997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:59.140380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.140864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.141291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.142143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.142619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.143038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.160774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:59.205776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:59.217454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7086114a-1bc0-49cf-8180-b0423ba756f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089276 Sep 01 08:18:59.218297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 302/610] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:59 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:18:59.469370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:59.470015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:59.476536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.477011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.477438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.478118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.478592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.479003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.501097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:59.504142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:59.510756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.511387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.511821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.512800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.513127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.513545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.542448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:59.556941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0910b880-3f41-46e3-914b-483e0f3b4aa3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.091677 Sep 01 08:18:59.557666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 309/611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:59 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:18:59.582129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:59.593180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:59.594640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:59.595758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-154ed224-c03b-4829-bd84-2db36d5da162 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.099302 Sep 01 08:18:59.596315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 303/612] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:18:59 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:18:59.744281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:18:59.744794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:18:59.750663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.751134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.751560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.752232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:18:59.752680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:18:59.753091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:18:59.812683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:18:59.821079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b7349a9f-6378-4369-a4db-37f14dc21a1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081275 Sep 01 08:18:59.821635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 310/613] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:18:59 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:00.149373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:00.149970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:00.156051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.156539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.157087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.157658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.158103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.158552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.223606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:00.231773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6696e38f-78d7-4c28-bca1-a1d20107f2f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086216 Sep 01 08:19:00.232493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 304/614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:00 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:00.238510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:00.239790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:00.247468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.247954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.248419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.249147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.249744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.250167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.314847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:00.325134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-382c75b4-f82b-4cdf-89d3-cc03684053af tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090731 Sep 01 08:19:00.325747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 311/615] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:00 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:00.578206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:00.578834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:00.587354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.587920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.588348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.589034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.589476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.589888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.629008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:00.629616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:00.637037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.637522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.637958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.638789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.639479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.640281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.654852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:00.665253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3c830c2-c835-406e-a550-a9b7be7de3a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.090688 Sep 01 08:19:00.666032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 305/616] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:00 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:00.708276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:00.718025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:00.721038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:00.721038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-50c822e4-683c-4ea0-9a86-9ce488bdbf79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095569 Sep 01 08:19:00.721252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 312/617] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:00 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:00.841241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:00.841879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:00.848176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.848657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.849084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.849765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:00.850238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:00.850686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:00.933911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:00.942374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-69832e44-b4ef-4773-bc7d-a428a89752be tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.104839 Sep 01 08:19:00.943760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 306/618] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:00 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:01.252783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:01.253485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:01.259744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.260228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.260655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.261346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.261798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.262206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.330697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:01.339884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c00d47d4-8e21-49fa-8537-2773d2f0b3f8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089777 Sep 01 08:19:01.339884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 313/619] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:01 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:01.345438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:01.346359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:01.352724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.353260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.353689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.354465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.354910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.355325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.418883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:01.427732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-474b87eb-70e2-4e2f-803e-9be7aac1e293 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086341 Sep 01 08:19:01.429007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 307/620] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:01 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:01.686945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:01.687572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:01.694728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.695371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.695988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.696668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.697113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.697529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.744073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:01.744586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:01.750633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.751124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.751547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.752240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.752696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.753093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.760774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:01.768432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-32f6d7d6-6a78-4161-bfe5-725bf7a233fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085216 Sep 01 08:19:01.769041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 314/621] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:01 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:01.818827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:01.830652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:01.832076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:01.833240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8d5bc424-9d9b-40b6-8144-a506cd8bc537 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.093670 Sep 01 08:19:01.833815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 308/622] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:01 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:01.965340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:01.965947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:01.972030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.972496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.972915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:01.973584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:01.974026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:01.974640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.035046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:02.042649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5d6e9b2d-306a-41ec-804a-d3f84bf4c60f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081200 Sep 01 08:19:02.043215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 315/623] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:01 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:02.359345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:02.359974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:02.361895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:02.367916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.368415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.368832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.369523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.369966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.370417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.432965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:02.440663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4e65bed3-1174-4a4b-bca3-42836635acfa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085074 Sep 01 08:19:02.441226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 309/624] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:02 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:02.451300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:02.451938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:02.453731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:02.454430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=6 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:02.460718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.461195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.461623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.462435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.462884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.463299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.526206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:02.533688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-185d237c-52e6-44ba-a189-18009eee7c37 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086224 Sep 01 08:19:02.534244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 316/625] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:02 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:02.791300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:02.791908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:02.797823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.798325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.798753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.799421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.799867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.800279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.857739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:02.858444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:02.864857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:02.865122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.865607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.866060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.867014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:02.867620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:02.868073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:02.873976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a65c1d1b-9ac4-4914-807c-bab0a6e698a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086880 Sep 01 08:19:02.874616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 310/626] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:02 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:02.931378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:02.939853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:02.941293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:02.942457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-627e8720-25d5-4080-ba57-2900dbcdbeba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088611 Sep 01 08:19:02.943001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 317/627] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:02 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:03.063209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:03.063820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:03.070064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.070560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.071001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.071693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.072143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.072562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.133742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:03.141927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4bbe2283-e468-4a5d-97f9-29a2269dc09f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082339 Sep 01 08:19:03.142595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 311/628] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:03 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:03.462753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:03.463371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:03.470157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.470667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.471282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.471976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.472423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.473421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.539806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:03.549545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-10dd2825-9014-4872-9462-6eeacd501432 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090547 Sep 01 08:19:03.549545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 318/629] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:03 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:03.555029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:03.556179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:03.562472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.562895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.563321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.564274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.564670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.565086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.644865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:03.652742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c7dbd45-cbc0-47b4-a5f8-e17183cadad0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.101774 Sep 01 08:19:03.653892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 312/630] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:03 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:03.895544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:03.896091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:03.902488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.903005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.903442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.904131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.904581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.905002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.968236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:03.969075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:03.969872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:03.976128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.976962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.977449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.978102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:03.978615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:03.978811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-94d7a877-460b-43b0-a6ee-5b576c0f6995 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087075 Sep 01 08:19:03.979036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:03.979386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 319/631] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:03 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:04.049708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:04.059643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:04.061697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:04.063735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e400f5c-0d0d-417e-aa97-f3659f6037bc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.099366 Sep 01 08:19:04.064696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 313/632] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:03 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:04.162210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:04.163462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:04.170088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:04.170675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:04.171116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:04.171798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:04.172244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:04.172660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:04.234019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:04.242280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb9e2842-9b27-4282-afd3-e728c52798ca tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083858 Sep 01 08:19:04.242838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 320/633] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:04 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:04.569663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:04.570422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:04.576743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:04.577223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:04.577788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:04.578850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:04.579306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:04.579731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:04.644207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:04.651853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a0b3941-fdc9-4bfc-8468-c285a2fb3396 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086644 Sep 01 08:19:04.652413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 314/634] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:04 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:04.674752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:04.675285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:04.681779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:04.682246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:04.682766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:04.683441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:04.683882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:04.684303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:04.746053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:04.755063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e04234bd-044a-4bab-8edb-145bd0cb4713 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084162 Sep 01 08:19:04.755837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 321/635] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:04 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:05.001193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:05.001812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:05.008704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.009196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.009630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.010370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.010822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.011252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.079050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:05.091595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:05.092215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:05.093232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e23326f8-22b1-472f-8783-ac4fa619d3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.095205 Sep 01 08:19:05.093820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 315/636] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:04 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:05.112059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.112550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.113042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.113730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.114175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.114655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.180695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:05.188875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:05.190321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:05.191425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-97d391a7-cbb8-42da-8e54-2280c779a501 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.107420 Sep 01 08:19:05.191976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 322/637] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:05 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:05.263696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:05.264305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:05.270737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.271126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.271635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.272448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.273064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.273495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.335789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:05.343917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-69f2ace1-dbb6-4294-8c86-b58a01834bcf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084028 Sep 01 08:19:05.344508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 316/638] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:05 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:05.672420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:05.673017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:05.679686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.680268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.680574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.681254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.681694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.682110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.700299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:05.744630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:05.752100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5235e662-33e6-47a7-823a-dcfa412f2023 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083550 Sep 01 08:19:05.752678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 323/639] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:05 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:05.776639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:05.777245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:05.783393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.783861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.784284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.784954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:05.785396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:05.785808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:05.846405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:05.854876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5adf9ab2-6b92-4101-b366-3f4963803838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082427 Sep 01 08:19:05.855344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 317/640] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:05 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:06.116874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:06.117469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:06.123603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.124081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.124514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.125192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.125637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.126052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.190292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:06.198601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9d64cdd0-36c7-4328-a7f4-8f99449e2419 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086056 Sep 01 08:19:06.199168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 324/641] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:06 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:06.214859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:06.215471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:06.221896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.222416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.222855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.223546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.224005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.224422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.292589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:06.300814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:06.302318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:06.303453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f87ddc95-d1e4-41e4-8fcc-6bbe1fd3644a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092487 Sep 01 08:19:06.304123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 318/642] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:06 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:06.364439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:06.365036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:06.371087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.371560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.371988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.372667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.373111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.373525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.436934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:06.445006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9927689e-351c-4375-bbcd-24469d3ba297 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084326 Sep 01 08:19:06.445577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 325/643] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:06 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:06.773162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:06.773760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:06.780001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.780648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.780893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.781577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.782017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.782465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.786567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:06.843721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:06.852591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-60980315-5ad5-4b34-9016-3f3996e0a081 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083755 Sep 01 08:19:06.853142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 319/644] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:06 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:06.873826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:06.874459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:06.880266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.880737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.881163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.881876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:06.882348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:06.882763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:06.942045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:06.950310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-50ede8f0-a668-4e21-93c9-f18776c7e1e1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080190 Sep 01 08:19:06.950869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 326/645] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:06 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:07.219366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:07.219962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:07.226417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.226886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.227310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.227983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.228422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.228835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.290710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:07.298509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15d5dbaf-6f13-42eb-af77-67675aa0f54e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083151 Sep 01 08:19:07.299064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 320/646] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:07 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:07.325804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:07.326433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:07.332487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.332968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.333398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.334097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.335088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.335517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.398321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:07.406633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:07.408052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:07.409154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-176210f5-11b0-42ce-9814-0172a4cd4ba6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087723 Sep 01 08:19:07.409701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 327/647] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:07 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:07.465585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:07.466201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:07.472356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.473180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.473294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.473936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.474412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.474836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.535392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:07.543859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ea547672-0917-444e-a529-8f9de252e1cc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082175 Sep 01 08:19:07.544403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 321/648] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:07 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:07.873422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:07.874113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:07.881048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.881615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.882042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.882909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.883432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.883775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.944935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:07.952488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1019c6b5-a49c-474d-b3da-9509ba8da928 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082889 Sep 01 08:19:07.953060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 328/649] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:07 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:07.971855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:07.972603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:07.980374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.981251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.981965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:07.983138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:07.983869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:07.984606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.052568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:08.061005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6931a820-138e-447b-a465-87055a7402f3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.093308 Sep 01 08:19:08.061565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 322/650] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:07 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:08.319934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:08.320532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:08.322694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:08.327792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.328277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.328709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.329402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.330012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.330563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.394840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:08.403587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1199c5b-3cf1-49f8-a154-3dfa0f2a2ad5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087643 Sep 01 08:19:08.404237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 329/651] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:08 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:08.432711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:08.433316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:08.439976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.440629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.440953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.441657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.442228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.442733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.511346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:08.520198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:08.521631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:08.523081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f7489469-8035-4a4e-88d2-0187873ca099 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095482 Sep 01 08:19:08.523650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 323/652] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:08 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:08.564693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:08.565444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:08.572309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.572870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.573373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.574363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.574717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.575305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.639479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:08.647587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8522e1ba-93d6-4dd3-943a-cc4c4ffb8007 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086068 Sep 01 08:19:08.648143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 330/653] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:08 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:08.973895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:08.974508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:08.980423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.980895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.981322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:08.982002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:08.982472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:08.982887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.060387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:09.068458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19bee728-d227-4c5a-b024-d3b8bf5dc4a5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.098485 Sep 01 08:19:09.081512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 324/654] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:08 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:09.083539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:09.084412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:09.090858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.091212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.091681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.092627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.093246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.093679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.159679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:09.169700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f3dfd5c-a638-43f0-a383-54719d32db92 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.092413 Sep 01 08:19:09.170332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 331/655] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:09 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:09.425330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:09.425936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:09.432977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.433466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.433978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.434618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.435063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.435484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.502726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:09.511411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2443daa0-0892-49c4-917b-ec5893db88b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089989 Sep 01 08:19:09.512222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 325/656] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:09 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:09.548206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:09.548813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:09.555456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.555950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.556384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.557087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.557532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.557980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.640623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:09.650029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:09.651828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:09.653130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b2b0cfbe-5734-4a54-8af1-7c89c25d9978 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.108934 Sep 01 08:19:09.653874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 332/657] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:09 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:09.669898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:09.670667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:09.677277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.677768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.682768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.683743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:09.684321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:09.684855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:09.749706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:09.759736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3379ab6e-2e53-41a3-91ef-11c8a63706fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.095068 Sep 01 08:19:09.760842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 326/658] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:09 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:10.090110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:10.090942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:10.097223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.097713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.098142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.098866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.099309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.099721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.177059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:10.194854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:10.196111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:10.205754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6fe2beb4-b4e4-442c-95db-fcca864a5b11 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.118898 Sep 01 08:19:10.206006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:10.208613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.209471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.210229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.210572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 333/659] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:10 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:10.211630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.212255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.213112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.300142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:10.311665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ae593834-e442-4b4f-9423-41bcac17bf02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.123693 Sep 01 08:19:10.312408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 327/660] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:10 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:10.532520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:10.533130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:10.540926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.541422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.541836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.542697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.543081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.543454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.613834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:10.622067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1f2fcb44-fd37-4b63-915f-7c25ecf0167c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.093345 Sep 01 08:19:10.622866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 334/661] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:10 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:10.676656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:10.678766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:10.686782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.687557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.688326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.689019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.689613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.690881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.764555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:10.776506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:10.778148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:10.779671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7bd36ea5-f374-47ca-9ea3-6391e7662958 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.107245 Sep 01 08:19:10.780313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 328/662] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:10 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:10.781704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:10.782352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:10.789637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.790137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.790602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.791479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:10.791966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:10.792467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:10.865124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:10.872805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ef22dd82-1576-4283-b29d-ebc578f6f1b5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.095164 Sep 01 08:19:10.873366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 335/663] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:10 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:11.238738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:11.239335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:11.255814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.256944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.257375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.258086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.258643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.258982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.339380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:11.341360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:11.349583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.350580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.351169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.352545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.353162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.353589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.526441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:11.532350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:11.537032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a1e6066-527e-4603-b6d9-e2835f8a5c07 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.303768 Sep 01 08:19:11.545120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a66ceb81-d0cc-4cde-b58e-17bb0366dc42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.209895 Sep 01 08:19:11.546035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 336/664] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:11 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:11.551066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 329/665] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:11 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:11.652281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:11.653094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:11.659597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.660364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.660956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.662051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.663361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.663950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.746730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:11.755951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-527b9562-96bb-4661-beca-e45376ad36ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.115377 Sep 01 08:19:11.757559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 337/666] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:11 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:11.806025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:11.806790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:11.820275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.820762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.821117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.822028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.826104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.827477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.898095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:11.898827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:11.920872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:11.922147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.922681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.923125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.926764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:11.928831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:11.930517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:11.933954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:11.936148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:11.937795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9166803b-ba7b-4d01-8c7b-d8dabfd24b72 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.136657 Sep 01 08:19:11.939107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 330/667] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:11 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:12.050314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:12.062734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a68342a9-f314-4065-8cec-23b25bf65f68 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.169407 Sep 01 08:19:12.078291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 338/668] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:11 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:12.560436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:12.561669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:12.569486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.570707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.571349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.571685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:12.572973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.573700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.573818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:12.574556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.583778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.584931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.585809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.587083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.587721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.588159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.703892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:12.715803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bde9554b-54a0-483c-a882-c553f362db33 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.159508 Sep 01 08:19:12.724152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 331/669] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:12 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:12.730306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:12.738851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f238da7e-f2ab-4fdc-9566-2680d0781e9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.173760 Sep 01 08:19:12.739718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 339/670] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:12 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:12.779131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:12.779752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:12.786430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.786913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.787504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.788445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.789095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.789522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.889243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:12.903090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c175f28d-d49f-40f3-af0d-6346a9a37b5b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.126984 Sep 01 08:19:12.907487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 332/671] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:12 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:12.965571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:12.966545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:12.978044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.979348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.980346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.981636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:12.982510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:12.983266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:12.990278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:13.090496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:13.091277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:13.098470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.099061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.099596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:13.101026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:13.101181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.102151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.102151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:13.110252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:13.111958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:13.113052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b580e0a1-11b0-4860-b089-3dd13095553c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.155879 Sep 01 08:19:13.113783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 340/672] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:12 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:13.185240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:13.193004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e98f9391-2e3e-47e2-95de-965c8b6ec929 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.106592 Sep 01 08:19:13.193569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 333/673] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:13 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:13.736760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:13.737360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:13.744075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.744628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.745257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:13.745957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.746437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.746856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:13.760981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:13.761519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:13.767622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.768105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.768529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:13.769218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.769663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.770074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:13.840579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:13.852325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-069d3225-cdc5-4af5-b592-734a7624f86a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.118951 Sep 01 08:19:13.853697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 341/674] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:13 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:13.884130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:13.893253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0549dfa8-3ce8-421f-be8a-b2c935b2d0b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.136048 Sep 01 08:19:13.894068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 334/675] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:13 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:13.941686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:13.942502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:13.957293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.957791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.958225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:13.958960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:13.960058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:13.960490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.049343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:14.060385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f191dbd-6829-4ece-8aa4-9a78b9ddbee4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.139527 Sep 01 08:19:14.061165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 342/676] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:13 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:14.143784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:14.145492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:14.154650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.156261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.157941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.159716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.160375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.162096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.219134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:14.219945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:14.235309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.236509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.236957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.237686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.238144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.240245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.352548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:14.356623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:14.365976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:14.367472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:14.384823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad4126f1-0de6-40fd-937d-d29e8b143621 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.251258 Sep 01 08:19:14.400357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 335/677] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:14 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:14.449665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:14.465044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3b3afac2-c66c-4780-9d31-af2331580b71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.252723 Sep 01 08:19:14.471159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 343/678] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:14 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:14.874494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:14.875804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:14.883970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.885062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.885721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.886872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.887528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.888254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.916372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:14.916937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:14.926403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.928759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.930670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.932121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:14.932765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:14.938621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:14.967953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:14.977229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e90e4760-cc8c-46b3-b53a-98dc259225d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.107041 Sep 01 08:19:14.978183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 336/679] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:14 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:15.039975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:15.073244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b0dd49dd-dd05-4c4e-8074-039715fb6081 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.162379 Sep 01 08:19:15.073880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 344/680] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:14 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:15.092990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:15.093828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:15.101199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:15.101948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:15.102945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:15.103989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:15.104654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:15.105265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:15.208500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:15.228078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-294a0461-596f-4231-bf90-9addfaf30a73 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.140175 Sep 01 08:19:15.229750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 337/681] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:15 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:15.414346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:15.416326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:15.423724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:15.424323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:15.424837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:15.425702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:15.426226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:15.426762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:15.491356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:15.492230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:15.511080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:15.511909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:15.512650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:15.513844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:15.515905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:15.516678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:15.556617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:15.582505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:15.586805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:15.591057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-48ac1c8a-2448-45ef-b848-89707b5703cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.182599 Sep 01 08:19:15.604881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 345/682] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:15 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:15.610906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:15.622601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9c93dd6c-25c5-429e-963f-d0a9e7dd8774 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.136066 Sep 01 08:19:15.624235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 338/683] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:15 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:15.999261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:16.000540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:16.007783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.009348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.010092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.011148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.012023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.012641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.098842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:16.109604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:16.110887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:16.135631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a3181902-c6bd-4588-938d-df07bad39669 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.140283 Sep 01 08:19:16.149038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 346/684] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:15 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:16.150947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.152485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.152933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.154436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.155199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.155939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.250515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:16.251544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:16.259876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.260763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.261916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.263124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.263941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.265381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.319153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:16.333293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bdfb0bf9-5dc9-45cd-81e5-606dd9012ca8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.240306 Sep 01 08:19:16.334981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 339/685] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:16 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:16.417650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:16.429631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-46894566-a924-4ea9-a415-3fbf4a9165dc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.182793 Sep 01 08:19:16.431432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 347/686] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:16 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:16.618109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:16.619163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:16.631305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.632317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.632978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.633795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.634309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.634713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.647061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:16.648251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:16.660084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.660581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.661026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.661740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:16.662355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:16.663446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:16.795495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:16.804347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:16.813073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:16.816938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2e2d181b-48c7-41d8-a44b-6ddbd3fbada0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.203216 Sep 01 08:19:16.823866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 340/687] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:16 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:16.863702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:16.874235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1cf19b86-0949-4198-8824-bcab370dfeb4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.232704 Sep 01 08:19:16.890494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 348/688] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:16 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:17.168676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:17.169278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:17.175892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.176373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.176970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.178402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.178849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.179359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.247648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:17.255166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ef571455-7393-450d-aaa5-900cffe61b09 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090214 Sep 01 08:19:17.255747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 341/689] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:17 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:17.356343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:17.356954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:17.362798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.363294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.363724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.364592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.365045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.365518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.428966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:17.436493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-73cc0f21-7feb-4186-8edb-6298da176946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084038 Sep 01 08:19:17.437060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 349/690] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:17 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:17.459874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:17.460405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:17.466381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.466860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.467554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.468235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.468705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.469116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.543629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:17.553825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f30dcb59-1f98-4bd1-b792-c23b2fa41f63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096893 Sep 01 08:19:17.554569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 342/691] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:17 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:17.847512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:17.848532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:17.855539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.856044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.856606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.857111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.857701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.858194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.903638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:17.904463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:17.911585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.912368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.912821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.913510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:17.913958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:17.914406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:17.935498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:17.947073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:17.949772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:17.951077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a34a3799-84bf-4619-a82d-d33e4f17afb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.107527 Sep 01 08:19:17.952138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 350/692] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:17 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:18.040698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:18.050879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1cbddb68-d5fc-4af8-9d9c-6a5b0f73bcdd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.155295 Sep 01 08:19:18.051523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 343/693] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:17 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:18.280827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:18.281120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:18.289567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.290185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.290803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:18.291699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.292205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.292713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:18.378119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:18.391157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33ebc912-8380-438e-bc69-d2ca82f25df2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.116533 Sep 01 08:19:18.392130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 351/694] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:18 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:18.457152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:18.457764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:18.465546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.466221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.472359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:18.473368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.474012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.475445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:18.555423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:18.565451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a300c0f4-357b-4cf2-a237-d7814486b17f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.112194 Sep 01 08:19:18.580562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:18.580775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 344/695] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:18 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:18.582130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:18.589454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.590072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.590747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:18.592069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.593160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.593818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:18.663763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:18.680251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2409e793-cd9f-4970-becf-1ff8279004b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.103116 Sep 01 08:19:18.685009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 352/696] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:18 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:18.975291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:18.976186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:18.983811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.984686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.985274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:18.986141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:18.986927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:18.987553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.059591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:19.069953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:19.071709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:19.073016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9542b841-dde0-478c-b110-ee7a1771ca34 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.102114 Sep 01 08:19:19.073155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:19.074188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:19.074373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 345/697] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:18 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:19.081612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.082157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.082688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.083400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.083845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.084971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.155412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:19.166235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-89ba65c6-ca4e-4940-a80f-a9d6bb82a667 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.097456 Sep 01 08:19:19.167145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 353/698] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:19 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:19.413826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:19.414735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:19.421245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.421990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.422606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.423481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.423926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.424517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.516456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:19.528003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-474c3cba-f6cd-4c64-b85d-8981f52967c3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.118531 Sep 01 08:19:19.531868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 346/699] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:19 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:19.593003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:19.594790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:19.606141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.607176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.608132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.609395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.610105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.610746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.693247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:19.706318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-27bbe10f-7b70-4363-bf59-4b20de57136e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.121049 Sep 01 08:19:19.707698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 354/700] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:19 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:19.713218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:19.713814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:19.723849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.724435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.725324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.726039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:19.726514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:19.726932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:19.846912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:19.864089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a98593f-3817-405c-a4f5-9efd4ed7f302 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.154499 Sep 01 08:19:19.872292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 347/701] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:19 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:20.117464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:20.117464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:20.140439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.147749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.148210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.148960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.150385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.153081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.188399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:20.189397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:20.210442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.211450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.216655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.218230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.221249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.223042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.289074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:20.300956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:20.308584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:20.309657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d2d21f47-db1d-4910-b33f-35ab6e0bf400 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.213631 Sep 01 08:19:20.326708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 355/702] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:20 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:20.367831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:20.379085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f926c260-f630-40b7-bf9e-e145239e9288 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.194963 Sep 01 08:19:20.381656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 348/703] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:20 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:20.575781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:20.576412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:20.596477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.597206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.597387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.606735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.607242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.607676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.727836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:20.734949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:20.745204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.752233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:20.760293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:20.762623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.763289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.765846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.766511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0d81803b-0e2b-4521-9bfe-684a67a9b567 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.220506 Sep 01 08:19:20.766643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.767020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.768791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 356/704] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:20 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:20.873676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:20.882969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a00301ff-2318-4727-99e6-705c861911ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.159142 Sep 01 08:19:20.884147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 349/705] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:20 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:20.900058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:20.900713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:20.907495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.910513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.911050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:20.912089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:20.912786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:20.913441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.024240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:21.033534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-60b35b40-a753-410f-8857-0f1a0e71783d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.138976 Sep 01 08:19:21.035080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 357/706] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:20 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:21.343053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:21.343665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:21.351772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.352549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.353334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.354216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.354985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.355690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.408566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:21.409982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:21.421146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.424130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.426863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.428724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.432456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.433154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.523503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:21.537399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:21.544326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:21.547806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-55e1647c-9fda-4f7c-ae64-bf657e7eb2a3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.209970 Sep 01 08:19:21.550482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 350/707] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:21 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:21.567182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:21.577925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8656cebb-45c8-44ea-8c6f-2671095804a3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.173310 Sep 01 08:19:21.579099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 358/708] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:21 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:21.788282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:21.789363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:21.803685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.804389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.809569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.810673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.811771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.812500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.906913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:21.907071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:21.907643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:21.922876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.927310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.928351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.929106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:21.929572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:21.929995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:21.933698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-11c37e75-cdfe-42bc-a567-7595d5f857f3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.139216 Sep 01 08:19:21.934816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 351/709] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:21 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:22.061186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:22.062617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:22.065998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:22.072794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.073644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.074293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:22.075549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.076206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.077078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:22.079478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24a25ea7-940f-4ca5-803f-d83c1975fe93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.179183 Sep 01 08:19:22.085660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 359/710] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:21 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:22.101611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:22.180441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:22.191906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3f981ebc-1dda-448a-9c19-4e75f62a742d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.140060 Sep 01 08:19:22.192960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 352/711] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:22 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:22.573544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:22.573544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:22.585183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.585686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.586125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:22.586863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.587310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.587729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:22.601435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:22.602059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:22.620049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.620548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.621013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:22.621721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.622168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.622641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:22.702568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:22.712075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:22.720402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:22.725987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a31915af-53a3-4b54-bbb0-270829a9be9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.155789 Sep 01 08:19:22.725987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 360/712] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:22 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:22.765994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:22.776073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a76c188-fe79-4398-b6b8-0790be421c93 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.179218 Sep 01 08:19:22.790243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 353/713] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:22 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:22.960141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:22.962628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:22.973455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.973941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.974546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:22.975248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:22.975700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:22.976123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.048485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:23.056393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4f7dd421-a432-46ed-8879-ab6468425427 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.102723 Sep 01 08:19:23.056988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 361/714] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:22 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:23.106530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:23.107694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:23.118986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.119866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.120544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.121525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.123034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.123748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.196737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:23.204893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-29d69139-ba8c-4473-ba8b-f4a6c01707b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.103554 Sep 01 08:19:23.205560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 354/715] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:23 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:23.217363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:23.218344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:23.225675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.226424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.227093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.227887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.228401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.228883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.301071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:23.309984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-590a4366-08e7-4def-9907-964b12af53f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097528 Sep 01 08:19:23.311244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 362/716] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:23 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:23.485165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-341740d4-5eff-4cc8-bf76-b4a27e5b02f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Action: 'create', calling method: .version_select at 0x7f2abf749ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1481646264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKKEaN55f2RS9hIp1w2231irck5bh1TKUzr7euc+sRfDHQYNUUvret+y8luYkIClOKJm8tB+GT1JdG3PlhkFCGMbhhiZDbfZeAf5RPzgm+jU7qjE7DDZzEZWp156V6LCg=="}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:19:23.500937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-341740d4-5eff-4cc8-bf76-b4a27e5b02f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Getting quotas for project f4336b9623424da8982f8a56ddee5a7a. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:19:23.504765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-341740d4-5eff-4cc8-bf76-b4a27e5b02f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Getting quotas for user bd69ef83d23d49fcbedcd308b1edf957 and project f4336b9623424da8982f8a56ddee5a7a. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:19:23.517129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR oslo.messaging._drivers.impl_rabbit [None req-341740d4-5eff-4cc8-bf76-b4a27e5b02f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [4f484b97-1284-42a0-80ff-27eb1ba8995d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 08:19:23.747114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:23.747633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:23.753504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.753985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.754481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.755164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.755639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.756620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.821412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:23.829885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:23.831359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:23.832458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-320327ae-c232-43d3-82c7-c89ce366133a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089284 Sep 01 08:19:23.833012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 363/717] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:23 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:23.838177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:23.838807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:23.844944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.845439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.845856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.846597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:23.847093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:23.847517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:23.908456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:23.916423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-258e04f3-fe0d-48ba-bd6d-86a1a26aaf9b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082428 Sep 01 08:19:23.916984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 364/718] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:23 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:24.077488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:24.078141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:24.084031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.084624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.084947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.085684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.086056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.086647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.147762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:24.155641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9943c229-fd87-4954-9ae9-1cd822906c66 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081942 Sep 01 08:19:24.156201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 365/719] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:24 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:24.228811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:24.229750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:24.236326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.237120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.237657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.238506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.239074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.239738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.311864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:24.321202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0524e0e1-8db5-4b36-bc81-8cb3de6a6ea5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.097481 Sep 01 08:19:24.321773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 366/720] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:24 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:24.332369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:24.333320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:24.339788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.340266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.340693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.341388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.341842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.342563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.406892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:24.415348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a22060e-c778-493f-bb3b-33e8239a0c24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086715 Sep 01 08:19:24.416012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 367/721] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:24 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:24.524457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [None req-341740d4-5eff-4cc8-bf76-b4a27e5b02f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [4f484b97-1284-42a0-80ff-27eb1ba8995d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 43806. Sep 01 08:19:24.542208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-341740d4-5eff-4cc8-bf76-b4a27e5b02f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.260874 Sep 01 08:19:24.543073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 355/722] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:19:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:19:24.858003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:24.859106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:24.866221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.866856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.867552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.868356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.868923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.869428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.940351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:24.941453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:24.950895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.951718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.952242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.953020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:24.953694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:24.954179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:24.960509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:24.971491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:24.977049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:24.978306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18fddc30-9edf-412f-8fed-ae954d809d04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.124546 Sep 01 08:19:24.982443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 368/723] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:24 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:25.038397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:25.067006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dcca9ff6-7298-4c94-a54b-d0403cb4daf8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.132528 Sep 01 08:19:25.067586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 356/724] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:24 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:25.177432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:25.178085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:25.185004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:25.185246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:25.185855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:25.186595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:25.187233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:25.187653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:25.264191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:25.276440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b4d385a8-bd4e-4cc2-a0bc-f27b543c1c3a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.103589 Sep 01 08:19:25.278672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 369/725] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:25 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:25.342235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:25.342883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:25.350001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:25.350419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:25.351017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:25.351648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:25.352187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:25.352601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:25.420875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:25.433196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9eefea9b-174d-4b83-bfc0-b1b2648b24e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.095111 Sep 01 08:19:25.434159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 357/726] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:25 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:25.451722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:25.452536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:25.459997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:25.460728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:25.461557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:25.463599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:25.464269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:25.465155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:25.537245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:25.546050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d88c79f-4ea8-4d95-acdf-8176ed7cfab2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.098232 Sep 01 08:19:25.547381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 370/727] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:25 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:26.006339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:26.007534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:26.013686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.014328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.015076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.015838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.016479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.017080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.084948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:26.091497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:26.092390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:26.106327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:26.108360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:26.109840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a304437-041f-4b3c-86b1-46b4d0ee3635 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.108394 Sep 01 08:19:26.110783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 358/728] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:25 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:26.114857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.116223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.116859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.117825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.118523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.119165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.207985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:26.217591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65f552ff-f403-4f39-8389-112fcc820454 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.131790 Sep 01 08:19:26.218766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 371/729] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:26 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:26.303267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:26.308971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:26.321614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.322110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.322557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.325705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.326185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.326696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.425179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:26.435614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80db4fce-b73c-4c5d-80fb-c7a4813e258e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.141753 Sep 01 08:19:26.436186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 359/730] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:26 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:26.466751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:26.467787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:26.488107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.489063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.489515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.490829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.491983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.492612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.569853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:26.570977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:26.578230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.578573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:26.579170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.579705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.580520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:26.581493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:26.582017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:26.586892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3e5b645-0d13-4bf8-9729-21f952555a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.125088 Sep 01 08:19:26.587787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 372/731] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:26 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:26.655079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:26.663949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8c154c42-ce5a-42a0-85f6-2f04812cd772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.100312 Sep 01 08:19:26.664506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 360/732] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:26 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:27.136688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:27.137226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:27.143222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.143636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.144065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.144741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.145185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.145599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.165865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:27.208281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:27.216790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:27.218484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:27.219562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fb6c91da-223e-4f4a-a51b-b12e82091350 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086923 Sep 01 08:19:27.220103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 373/733] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:27 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:27.240260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:27.240931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:27.246929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.247406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.247838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.248523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.248967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.249389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.316074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:27.324518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b2adb35-edbc-40a8-a97c-a2e43bb71752 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088429 Sep 01 08:19:27.325079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 361/734] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:27 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:27.460776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:27.461409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:27.468272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.468759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.469360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.470065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.470541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.471128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.540190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:27.548536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-374bb6b9-dc08-44ea-88c0-88226218a155 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.091579 Sep 01 08:19:27.549117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 374/735] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:27 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:27.609118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:27.609855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:27.617121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.617703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.618199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.619059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.619501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.620005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.685697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:27.686064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:27.688003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:27.693103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.694103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.694606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.695336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:27.695781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:27.696194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:27.697195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a2eedc54-610d-4c70-83cb-c61e6524e610 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091877 Sep 01 08:19:27.697772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 362/736] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:27 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:27.766048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:27.775058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9dc6f27e-5c6e-40ea-a553-109e200efab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.093892 Sep 01 08:19:27.775618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 375/737] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:27 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:28.243591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:28.244192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:28.250277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.250768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.251203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.252090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.252327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.252752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.317445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:28.325922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:28.327392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:28.328520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-18734dd9-22e7-4d21-84b7-954a3ff346d1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089645 Sep 01 08:19:28.329233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 363/738] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:28 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:28.345926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:28.347332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:28.355517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.356000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.356424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.357117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.357559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.357967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.429108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:28.439813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-118e032f-76ee-41a2-9dae-7dd16528328e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.097663 Sep 01 08:19:28.440840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 376/739] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:28 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:28.570167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:28.570801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:28.576888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.577378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.577811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.578547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.579000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.579421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.642952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:28.651158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a511eec-55b7-40bc-bb0c-0c275c8fdc74 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085076 Sep 01 08:19:28.651726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 364/740] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:28 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:28.725149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:28.725667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:28.733334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.734051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.734568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.735272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.735756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.736168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.797934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:28.798829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:28.805539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.806037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.806511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.807218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:28.807671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:28.808238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:28.809869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:28.824054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-78755725-b223-4f27-b840-9de22d9da093 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.102462 Sep 01 08:19:28.825095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 377/741] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:28 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:28.873419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:28.882218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-10d002a2-9d46-46b8-bb3f-d4e3eb721a78 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088849 Sep 01 08:19:28.882802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 365/742] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:28 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:29.352580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:29.353179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:29.359222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.359692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.360165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.361101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.361692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.362227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.428127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:29.436377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:29.437858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:29.438981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0cce454b-5937-4ce4-8b72-ee5805de2ea1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090874 Sep 01 08:19:29.439528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 378/743] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:29 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:29.464161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:29.465110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:29.473430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.473430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.473747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.475029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.475476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.475891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.654718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:29.662781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1853a0f-df81-46ff-9cc2-8c426427510b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.202434 Sep 01 08:19:29.663319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 366/744] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:29 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:29.671805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:29.673039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:29.676668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:29.681166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.681642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.682103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.682811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.683280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.683690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.748721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:29.757019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ab60ef8b-dddd-4a31-a8ad-fe666d14fd23 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089141 Sep 01 08:19:29.757574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 379/745] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:29 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:29.852066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:29.852899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:29.860638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.861222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.861656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.862386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.862954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.863283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.903602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:29.904148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:29.910129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.910657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.911089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.912341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:29.912878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:29.913324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:29.931068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:29.938496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4bcebd6-5d0e-4bec-9748-d931286328b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091971 Sep 01 08:19:29.939059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 367/746] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:29 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:29.978166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:29.985890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aa31461e-4915-4647-b80b-6db21a01760e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086104 Sep 01 08:19:29.986489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 380/747] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:29 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:30.463435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:30.464305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:30.472112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.472694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.473009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:30.473696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.474346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.474870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:30.539378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:30.547464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:30.548888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:30.549968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e43b5d1b-d2b9-4453-895e-d709b0e85be9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091883 Sep 01 08:19:30.550544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 368/748] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:30 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:30.684744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:30.685363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:30.691428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.691907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.692330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:30.693066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.694040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.694580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:30.757962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:30.765621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-50c12c56-347f-48b6-83a3-7ae377919ae4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084933 Sep 01 08:19:30.766174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 381/749] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:30 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:30.777493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:30.778106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:30.783964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.784440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.784873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:30.785557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.786038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.786484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:30.847524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:30.855277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26d11b75-2768-46bf-bc96-22500f2c74f7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082244 Sep 01 08:19:30.855839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 369/750] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:30 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:30.959899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:30.960503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:30.968680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.969208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.969753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:30.970567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:30.971028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:30.971445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.007292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:31.007821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:31.015432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.015842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.016363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.017098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.017516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.017936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.023021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:31.034504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:31.046826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-98176d77-d161-45f8-91fb-10510e076a5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091336 Sep 01 08:19:31.047415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 382/751] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:30 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:31.084327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:31.092467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-caadc53d-b089-4c2e-9d0a-fedb565957c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089843 Sep 01 08:19:31.093025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 370/752] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:31 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:31.572807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:31.573398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:31.579356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.579829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.580252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.580929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.581370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.581787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.643451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:31.651708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:31.652965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:31.654046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a66c4de3-ca02-455d-bebc-2a9101a445d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085707 Sep 01 08:19:31.654694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 383/753] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:31 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:31.784925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:31.785530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:31.792829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.793311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.793743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.794628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.795102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.795645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.861153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:31.870196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9a7d3b2d-6dfd-4acc-88b1-0475c9a59e9a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089064 Sep 01 08:19:31.871157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 371/754] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:31 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:31.875428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:31.876027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:31.882849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.883328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.883925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.884614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:31.885059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:31.885465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:31.947734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:31.955311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd861141-6bf0-4f7c-b464-898a72091a28 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083807 Sep 01 08:19:31.955878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 384/755] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:31 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:32.067260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:32.067977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:32.070392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:19:32.070575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 (ip 10.222.0.43) !!! Sep 01 08:19:32.072361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:32.080245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.080726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.081152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.081848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.082312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.082733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.113192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:32.113800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:32.121325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.121837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.122315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.123017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.123664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.126058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.156763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:32.164953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c10553f7-69c4-42fc-afaa-b5cba4c51971 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.101606 Sep 01 08:19:32.165529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 372/756] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:32 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:32.196261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:32.203958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6eedd68a-7f8b-4d52-9d40-25bea8f9479e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094716 Sep 01 08:19:32.204509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 385/757] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:32 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:32.677111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:32.677807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:32.683763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.684298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.684724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.685398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.685842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.686283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.750475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:32.759719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:32.761263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:32.762392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ce7d04f8-a5d0-41f8-acc9-65124b6be889 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089204 Sep 01 08:19:32.762935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 373/758] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:32 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:32.892001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:32.892631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:32.899722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.900198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.900625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.901303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.901746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.902158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.973475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:32.977745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:32.978300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:32.982841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9003c1f-7673-4b7b-abeb-495aa3364d62 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.094570 Sep 01 08:19:32.983411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 386/759] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:32 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:32.984096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.984683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.985112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:32.985829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:32.986352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:32.986772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:33.050851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:33.058731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee7cc8fb-57f9-45de-aea7-091bfb9d5bc8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085749 Sep 01 08:19:33.059293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 374/760] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:32 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:33.186867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:33.187690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:33.195109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:33.195773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:33.196393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:33.197090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:33.197536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:33.197951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:33.225593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:33.226208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:33.232604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:33.233024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:33.233459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:33.234158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:33.234643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:33.235258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:33.271838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:33.279609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-84fbe639-4ef5-4560-bdcd-9471e3987395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.096952 Sep 01 08:19:33.280183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 387/761] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:33 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:33.301603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:33.309712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9a07dc9-9ce1-4971-9964-2129fbaa2ada tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088792 Sep 01 08:19:33.310620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 375/762] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:33 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:33.784911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:33.785512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:33.793935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:33.794461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:33.794891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:33.795580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:33.797790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:33.797790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:33.859973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:33.868558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:33.869967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:33.871074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4baeb2a2-a785-4f13-b625-1ad5023671f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089990 Sep 01 08:19:33.871714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 388/763] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:33 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:34.004248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:34.004947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:34.007115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=4 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:34.013294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.013783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.014214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.014948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.015396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.015815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.079729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:34.080343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:34.081976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:34.086429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.086911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.087333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.088026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.088472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.088890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.089837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-22379936-258e-464c-b57e-f5dcda35e420 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090092 Sep 01 08:19:34.090437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 376/764] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:33 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:34.153251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:34.161008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61a0cbfd-1c58-4f26-9bfd-47eb6233f5aa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085062 Sep 01 08:19:34.161579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 389/765] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:34 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:34.300572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:34.301177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:34.308726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.309314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.310011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.310916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.311402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.312127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.330321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:34.330896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:34.338039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.338555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.339129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.339933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.340432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.340863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.345497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:34.379776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:34.388221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-73b3149f-44fc-45bf-a529-cbe01a940f44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091313 Sep 01 08:19:34.388785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 377/766] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:34 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:34.406860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:34.415091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7f983af5-09e1-4ce2-86c0-5adde9fb4b63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088774 Sep 01 08:19:34.415649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 390/767] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:34 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:34.895470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:34.896081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:34.902133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.902662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.903098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.903788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:34.904248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:34.904671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:34.971887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:34.979857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:34.981280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:34.982435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-361b39b3-e75c-40c5-bd60-dca5bd162f8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090810 Sep 01 08:19:34.983005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 378/768] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:34 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:35.111351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:35.112015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:35.121312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.121864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.122225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.122939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.123734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.123895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.183723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:35.184520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:35.193632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.195469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.196105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.197018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.197256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:35.197467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.197884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.211271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1561764e-c1bd-4afc-b7f8-57882a74ed72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.103601 Sep 01 08:19:35.212322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 391/769] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:35 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:35.259485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:35.267428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c3457b51-e94f-4c73-9453-6ca32f7e0f29 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087641 Sep 01 08:19:35.267977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 379/770] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:35 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:35.410181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:35.410815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:35.417751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.418223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.418672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.419431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.419800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.420220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.436432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:35.437112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:35.445476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.445966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.446619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.447543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:35.448033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:35.448447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:35.495761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:35.503706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b80c592-7ea6-409b-8de8-27c34a11fdb1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.098216 Sep 01 08:19:35.504277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 392/771] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:35 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:35.541181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:35.550890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-908b8d47-bc91-47e5-81a9-c0f915eb644c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.118688 Sep 01 08:19:35.550890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 380/772] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:35 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:36.005196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:36.005773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:36.012606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.013149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.013579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.014287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.014743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.015162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.079927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:36.088765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:36.090496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:36.092382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed40be59-ba44-4ca4-8bbe-aaaf82014c5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090528 Sep 01 08:19:36.092382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 393/773] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:35 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:36.232775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:36.233408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:36.239994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.240483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.240930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.241762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.242204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.242641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.289371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:36.290214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:36.296661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.297255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.297810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.298510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.298944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.299459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.316748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:36.325939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57fafe1b-7acc-4728-abf4-bc4e30d4481d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.097193 Sep 01 08:19:36.327099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 381/774] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:36 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:36.363338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:36.370986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fce1286d-e012-4ba2-b1cb-39f5444b973a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086353 Sep 01 08:19:36.371546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 394/775] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:36 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:36.526201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:36.526769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:36.532897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.533315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.533741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.534487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.534987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.535344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.572030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:36.572643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:36.580227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.581036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.581806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.583048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:36.583849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:36.584588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:36.603082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:36.611171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8853a0f3-07c7-4816-ac03-3e059e0bb53c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089884 Sep 01 08:19:36.611910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 382/776] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:36 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:36.669508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:36.677198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d4ad36c4-67fe-49ae-8167-d2f1ccad1044 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.109929 Sep 01 08:19:36.677760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 395/777] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:36 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:37.114937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:37.115450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:37.121312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.121785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.122211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.122902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.123345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.123781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.183137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:37.190968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:37.192379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:37.193449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dfce5165-7b29-4a22-9b38-927b016bef99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.082497 Sep 01 08:19:37.194545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 383/778] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:37 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:37.347655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:37.348301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:37.354786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.355267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.355693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.356381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.356825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.357237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.393546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:37.394247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:37.400033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.400517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.400954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.401667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.402117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.402583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.420884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:37.428950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e1213404-bda8-4db1-b7cd-9e89ca6e868a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084640 Sep 01 08:19:37.429456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 396/779] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:37 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:37.466157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:37.474217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62dda9bc-4c72-4c32-a2e5-49c6420134b6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084662 Sep 01 08:19:37.474809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 384/780] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:37 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:37.632420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:37.633023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:37.639091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.639572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.640012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.640698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.641142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.641559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.698828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:37.699462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:37.705637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.706155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:37.706354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.706781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.707569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:37.708088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:37.708591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:37.716225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8012618c-d84b-471f-9c21-08a7ee2f2e63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087657 Sep 01 08:19:37.717075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 397/781] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:37 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:37.769549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:37.777749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-54f45b27-9b04-44b1-9a84-ba599de8aaf9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083351 Sep 01 08:19:37.778333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 385/782] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:37 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:38.216900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:38.217497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:38.223334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.223810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.224239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.224914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.225980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.226433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.286904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:38.294810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:38.296232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:38.297320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3cc2df6a-8ccf-4ec4-a049-0e49f6427892 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084526 Sep 01 08:19:38.297869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 398/783] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:38 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:38.449925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:38.450546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:38.456531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.457011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.457442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.458135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.458604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.459017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.495498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:38.496230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:38.502459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.503030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.503530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.504308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.504817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.505330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.522148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:38.526415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:38.531528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-85dfefc6-ccb1-4b4e-ac03-afa87bfeaca7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085466 Sep 01 08:19:38.532471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 386/784] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:38 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:38.578095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:38.586505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6e13317c-ae7c-437b-8204-2390ed8687d5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.094713 Sep 01 08:19:38.587074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 399/785] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:38 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:38.737558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:38.738382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:38.744641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.745123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.745553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.746243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.746716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.747138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.799785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:38.800397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:38.807042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.807674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.807962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.808659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:38.809109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:38.809531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:38.810734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:38.818476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee4cdd87-8d65-4b8b-8150-37266135bd0b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085016 Sep 01 08:19:38.819746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 387/786] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:38 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:38.872950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:38.880684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a6afbaf2-3e43-4b14-8b8e-2f0e0ff29cf0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084930 Sep 01 08:19:38.881241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 400/787] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:38 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:39.320226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:39.320834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:39.326729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.327216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.327651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.328332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.328781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.329201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.388221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:39.396148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:39.397964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:39.399112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6028027a-6717-49dd-ba9c-26f0268a2a88 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.082802 Sep 01 08:19:39.399674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 388/788] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:39 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:39.551950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:39.552548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:39.559473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.559962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.560405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.561101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.561553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.561972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.607306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:39.607870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:39.613700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.614180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.614647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.615391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.615857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.616273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.634097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:39.642986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-56df596b-309f-494f-aa29-afb6d3296e58 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.094796 Sep 01 08:19:39.643581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 401/789] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:39 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:39.678553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:39.686640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1f4378c1-64e1-413a-aa18-8592bf4401b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083148 Sep 01 08:19:39.687195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 389/790] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:39 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:39.839533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:39.840130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:39.846598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.847077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.847665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.848284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.848808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.849311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.901066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:39.901823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:39.907839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.908329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.908756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.909450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:39.909892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:39.910187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:39.910837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:39.919073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea39f88f-24a1-42f0-9753-8cc2058434db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083459 Sep 01 08:19:39.919652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 402/791] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:39 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:39.974930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:39.982972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24781b56-a0b5-47d4-9cd3-4c326a74c784 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085852 Sep 01 08:19:39.983530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 390/792] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:39 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:40.424628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:40.425177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:40.432173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.432649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.433078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:40.433761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.434205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.434657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:40.501564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:40.512088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:40.513770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:40.515657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cdd8d63c-a73b-4382-9ae1-1e35156a79bb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094837 Sep 01 08:19:40.516216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 403/793] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:40 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:40.663555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:40.664290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:40.670191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.670701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.671125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:40.671811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.672255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.672668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:40.707830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:40.708372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:40.715251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.715734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.716165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:40.717123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.717570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.717990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:40.734805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:40.743361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3258228-4895-4c9f-9841-feeaec7cfdfb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083651 Sep 01 08:19:40.743939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 391/794] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:40 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:40.779997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:40.787506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9e0db028-882f-468c-9114-1c0b228a7804 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083518 Sep 01 08:19:40.788059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 404/795] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:40 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:40.945699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:40.946530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:40.952536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.953025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.953460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:40.954154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:40.954638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:40.955062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.003600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:41.004223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:41.011116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.011602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.012035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.012726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.013175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.013593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.018658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:41.027923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19658f78-b0c4-4d22-8ea0-c30ba5d5b3ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086628 Sep 01 08:19:41.028537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 392/796] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:40 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:41.078406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:41.086645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7eec0075-0f42-4680-8d15-d9ef3215dd6f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086849 Sep 01 08:19:41.087211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 405/797] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:40 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:41.214441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1388162894", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1481646264", "security_groups": [{"name": "tempest-secgroup-smoke-1734721"}], "networks": [{"uuid": "eadffde8-edb1-4b03-8d30-a9468acc077b"}], "block_device_mapping_v2": [{"uuid": "ca7ce88a-3070-4e48-9420-7335fff0261f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:19:41.326014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] validate_networks() for [('eadffde8-edb1-4b03-8d30-a9468acc077b', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:19:41.543082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:41.543082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:41.547985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.548470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.548900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.549591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.550037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.550493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.622771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:41.626121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:41.631578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:41.633249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:41.634511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c96c2e3a-b4f8-4369-8099-c78717fe9264 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.097463 Sep 01 08:19:41.635269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 406/798] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:41 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:19:41.736583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:19:41.737077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:19:41.737442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:19:41.737842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:19:41.738250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:19:41.747154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.747628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.748055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.748765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.749203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.749612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.764712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:41.765358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:41.766272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Getting quotas for project f4336b9623424da8982f8a56ddee5a7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:19:41.770189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Getting quotas for user bd69ef83d23d49fcbedcd308b1edf957 and project f4336b9623424da8982f8a56ddee5a7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:19:41.771703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.772194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.772628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.773838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.774325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.774734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.834793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:19:41.837838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca7ce88a-3070-4e48-9420-7335fff0261f',volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:19:41.838562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:41.847740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b0fae43-de09-4a09-85fc-b6e3a16ebd1e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087477 Sep 01 08:19:41.848459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 407/799] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:41 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:41.854012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:41.854641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:41.860939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.861240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.861669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.862382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:41.862830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:41.863244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:41.927365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:41.936768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18ca4c80-da17-455c-ba6c-44950553bb79 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087284 Sep 01 08:19:41.937344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 408/800] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:41 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:42.009900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-12727c1b-9db3-4e1a-b030-5fc774165cba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.799764 Sep 01 08:19:42.010705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 393/801] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:19:41 2022] POST /compute/v2.1/servers => generated 403 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:19:42.021450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e6480f96-1fe6-4838-ac49-b06eca20a2b0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:42.021977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e6480f96-1fe6-4838-ac49-b06eca20a2b0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:42.048769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:42.049197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:42.055925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.056449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.056884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.057587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.058036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.058492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.079789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e6480f96-1fe6-4838-ac49-b06eca20a2b0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:42.089367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e6480f96-1fe6-4838-ac49-b06eca20a2b0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1089 microversion: 2.1 time: 0.071286 Sep 01 08:19:42.092540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 409/802] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:42 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:42.107851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:42.108470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:42.116631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.117357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.117903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.118682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.121190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.121190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.131313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:42.141069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1cd3752b-da39-40aa-acbb-c147300cb3a7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.096190 Sep 01 08:19:42.141645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 394/803] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:42 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:42.187709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:42.196274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2c70c00d-244a-49e6-b54c-e83fe7f7cef0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092119 Sep 01 08:19:42.196834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 410/804] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:42 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:42.657165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:42.657793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:42.663791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.664344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.664781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.665469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.665914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.666355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.728002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:42.735902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:42.737308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:42.738416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ef4e45b0-ee16-4e2f-9e9c-904e1cdc57fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085115 Sep 01 08:19:42.738954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 395/805] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:42 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:42.879816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:42.880423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:42.887248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.887698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.888223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.888813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.889261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.889680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.950779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:42.956907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:42.957525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:42.959221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-70c06300-e399-4410-989b-18ebddffb59d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083429 Sep 01 08:19:42.959800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 411/806] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:42 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:42.963751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.964238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.964670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:42.965367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:42.965818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:42.966238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.026617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:43.034021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7ccc169c-b8fe-41b2-a650-c8326f5d81f6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.080879 Sep 01 08:19:43.034605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 396/807] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:42 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:43.110855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:43.111463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:43.117994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.118494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.118922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.119594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.120037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.120452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.161705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:43.162350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:43.169329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.169811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.170243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.170961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.171408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.171823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.182441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:43.192290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c236595c-9506-4cb9-bb49-31d98162fc13 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085039 Sep 01 08:19:43.192985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 412/808] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:43 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:43.217562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:43.218206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:43.224228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.224707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.225133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.225818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.227204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.227621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.239870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:43.251260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7c337f81-e6ec-414a-b977-3ed98298112a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.093102 Sep 01 08:19:43.252387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 397/809] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:43 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:43.303421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:43.311029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0aeec715-b5a6-4831-a417-cd97a8f94f58 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097986 Sep 01 08:19:43.311579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 413/810] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:43 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:43.762219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:43.762814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:43.768677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.769151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.769578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.770272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.770724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.771204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.831080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:43.840373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:43.842030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:43.843178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8772c604-1a92-42a3-9df2-6f8b398e64a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085129 Sep 01 08:19:43.843729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 398/811] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:43 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:43.980317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:43.980924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:43.987922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.988404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.988833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:43.989556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:43.990032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:43.990480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.052143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.055465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:44.056048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:44.062015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.062545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.062973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.063689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.064137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.064257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3265bdb6-5c76-47f5-965f-1eb97178263b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087368 Sep 01 08:19:44.064550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.065281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 414/812] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:43 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:44.128988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.137321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04344667-c745-4323-90b5-9e2c74cb0612 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086314 Sep 01 08:19:44.137868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 399/813] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:44 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:44.212812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:44.213414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:44.219567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.220041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.220466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.221140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.221585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.222003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.281330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.282690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:44.283292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:44.289217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.289622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3ca00f6c-1597-4200-a878-f369a8fd9b46 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080486 Sep 01 08:19:44.289826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.290418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.290542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 415/814] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:44 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:44.290868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.291314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.291740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.331532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:44.332054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:44.338558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.339044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.339474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.340182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.340623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.341040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.356550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.364743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8577b5cc-2440-4bc9-b8cf-ca15c5476be6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085804 Sep 01 08:19:44.365518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 400/815] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:44 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:44.402802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.410502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0515d6f-1bbc-4b26-aede-2b4278d7c49d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082724 Sep 01 08:19:44.411070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 416/816] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:44 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:44.867180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:44.867763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:44.873616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.874089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.874545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.875219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:44.875661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:44.876072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:44.937483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.946459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.947995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:44.949160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19467029-6e3c-47d2-b76e-b4c7ee768409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086407 Sep 01 08:19:44.949742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 401/817] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:44 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:45.092202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:45.092823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:45.099013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.099497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.099922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.100760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.101168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.101584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.157139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:45.157785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:45.164610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.165099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.165531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.166227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.166710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.167131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.272714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:45.281071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7972494-0048-4d83-be2d-a3c2a5f9b21b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.192834 Sep 01 08:19:45.281640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 417/818] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:45 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:45.299456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:45.307221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c489b1e-43c4-4c12-b947-05f6f2e93ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.154043 Sep 01 08:19:45.307770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 402/819] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:45 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:45.310065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:45.310713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:45.316559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.317041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.317476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.318162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.318648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.319070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.379735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:45.389341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:45.390081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:45.392447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2beb6358-515a-4ed8-9188-de79a816511b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086051 Sep 01 08:19:45.393626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 418/820] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:45 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:45.399736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.400688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.401449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.402680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.403321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.403926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.432315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:45.432918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:45.439234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.439717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.440168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.440854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.441329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.441781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.468673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:45.478198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-614fca68-5abc-4594-b337-95db655deed8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094589 Sep 01 08:19:45.478799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 403/821] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:45 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:45.511417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:45.520096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-903a3cb4-ae0c-4fe8-95cc-5df1a2249bdd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092234 Sep 01 08:19:45.521258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 419/822] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:45 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:45.971973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:45.972562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:45.978470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.978946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.979373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.980048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:45.980492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:45.980905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:45.984685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:46.040810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.048992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.050464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.051549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-104212b6-da77-4cb5-be84-aa6a9be65c70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083441 Sep 01 08:19:46.052090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 404/823] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:45 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:46.302000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:46.302671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:46.308648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.309139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.309570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.310270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.310731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.311154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.328461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:46.329070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:46.334868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.335884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.336456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.337148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.337598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.338012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.371951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.379548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7566640-d5cb-4902-a58c-90bcb0f33da5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081480 Sep 01 08:19:46.380316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 420/824] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:46 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:46.399336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.406902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c43c4b69-3c40-41cb-978f-13ba09f5ae38 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082326 Sep 01 08:19:46.407475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 405/825] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:46 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:46.415245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:46.415633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:46.421674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.422147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.422617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.423299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.423743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.424161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.487505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.496408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-70165db2-2838-42fa-89be-b20e819e09ba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086014 Sep 01 08:19:46.496979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 421/826] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:46 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:46.498810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:46.499602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:46.506292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.506793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.507847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.508760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.509192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.509623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.541003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:46.541604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:46.547624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.548107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.548533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.549224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:46.549663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:46.550102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:46.580134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.589107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e110b096-7e71-44b2-80f4-075cce12c1eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094067 Sep 01 08:19:46.589696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 406/827] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:46 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:46.615128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:46.623582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-583f74bb-485a-4269-a6ae-797551d525b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086353 Sep 01 08:19:46.624161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 422/828] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:46 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:47.073559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:47.074135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:47.080134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.080608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.081037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.081712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.082152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.082601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.141775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.149736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.151174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.152249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3efb5381-0409-4d98-86dd-d4aca71cedcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083190 Sep 01 08:19:47.152793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 407/829] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:47 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:47.400275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:47.400828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:47.406788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.407263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.407690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.408397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.408844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.409251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.427982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:47.428679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:47.435171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.435650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.436163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.436868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.437318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.437734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.478696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.486479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65ef7d7f-dd1d-47b1-a46b-7b10b6b03f91 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090158 Sep 01 08:19:47.487055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 423/830] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:47 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:47.507250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.515082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c871639e-8c42-48ad-b310-61d105cf01ef tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090980 Sep 01 08:19:47.515791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 408/831] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:47 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:47.518961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:47.519664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:47.525947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.526541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.527047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.527809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.528266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.528685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.548062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:47.592273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.599789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-685526bd-7537-4f51-bd5d-5d6554c7fb0b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085573 Sep 01 08:19:47.600342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 424/832] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:47 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:47.610110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:47.610779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:47.617314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.617789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.618212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.618920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.619362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.619777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.644668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:47.645361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:47.651462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.651932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.652363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.653047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:47.653489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:47.653902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:47.680571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.688016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8bb6f692-28c7-4291-9264-f8d6a5c6c9f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082012 Sep 01 08:19:47.688571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 409/833] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:47 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:47.716980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:47.724445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1859d407-b551-4ba4-8555-3ff14f868d98 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083498 Sep 01 08:19:47.725000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 425/834] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:47 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:48.174648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:48.175278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:48.182014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.182515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.182945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.183626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.184068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.184483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.246774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.254751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.256154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.257254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e4ee9be-34a6-4d76-8382-62c07a88dc9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086689 Sep 01 08:19:48.257795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 410/835] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:48 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:48.507057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:48.507732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:48.513729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.514202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.514661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.515349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.515806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.516220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.535683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:48.536292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:48.542889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.543374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.543809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.544498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.544952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.545380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.578034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.588208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e913bc5f-96d5-45d4-902c-6976b855ae6d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084969 Sep 01 08:19:48.589210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 426/836] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:48 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:48.606971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.614618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1652576a-c1b3-477f-bd15-49d00dd1b178 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082788 Sep 01 08:19:48.615189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 411/837] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:48 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:48.620608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:48.621209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:48.627104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.627582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.628008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.628688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.629133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.629551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.691831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.699436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-366b7298-61e4-4003-a537-6bd0441c55d7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082833 Sep 01 08:19:48.699988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 427/838] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:48 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:48.708730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:48.709351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:48.715733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.716206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.716887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.717560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.718055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.718497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.745570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:48.746097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:48.748007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:48.753238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.753722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.754150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.754863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:48.755310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:48.755727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:48.779891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.787330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93ae4434-ba3f-49f1-9a40-5e59f01c9337 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082306 Sep 01 08:19:48.788038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 412/839] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:48 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:48.816153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:48.824337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93b452d2-064f-4711-96c4-e636e824fde8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082586 Sep 01 08:19:48.824892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 428/840] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:48 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:49.279846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:49.280431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:49.286336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.286814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.287238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.287919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.289124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.289544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.349299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.357855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.359306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.360376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e15ce88f-df4f-4118-abfe-17ee19c68a6c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084458 Sep 01 08:19:49.360968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 413/841] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:49 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:49.610317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:49.610922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:49.616971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.617461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.617908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.618633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.619083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.619506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.635211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:49.635811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:49.637689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:49.643608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.644089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.644520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.645209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.645654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.646068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.686003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.693995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-edf53b53-805e-4bc5-b21b-8603b026f568 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087548 Sep 01 08:19:49.695137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 429/842] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:49 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:49.713127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.720535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:49.721145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:49.721252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3752c23-14bf-4944-aa2c-8cbd2d7d817b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090218 Sep 01 08:19:49.721732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 414/843] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:49 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:49.727328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.727808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.728262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.728971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.729418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.729829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.790041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.797644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1dc733f-c507-4b7a-9352-8788fdea53e7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081089 Sep 01 08:19:49.798235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 430/844] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:49 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:49.807616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:49.808313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:49.814337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.814817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.815253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.815941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.816380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.816797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.845122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:49.845745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:49.852286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.852773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.853205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.853893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:49.854369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:49.854789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:49.877846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.886067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e0340012-0b52-40f2-a6f3-9390b3ac44cf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082464 Sep 01 08:19:49.886738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 415/845] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:49 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:49.915235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:49.923153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30a781e5-4af1-45ec-9430-7ea267bc9b64 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082197 Sep 01 08:19:49.923705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 431/846] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:49 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:50.383690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:50.384288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:50.390132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.390731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.391061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.391751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.392172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.392584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.454614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:50.463805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:50.465247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:50.466671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd6b482b-27b0-4a79-a62d-bc6799387ae3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087133 Sep 01 08:19:50.469045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 416/847] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:50 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:50.715676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:50.716518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:50.722549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.723034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.723471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.724165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.724618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.725038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.740862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:50.741494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:50.747856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.748326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.748755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.749431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.749874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.750310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.787692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:50.795447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21d0726c-3996-46a8-9ec8-25c23addfe1f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083808 Sep 01 08:19:50.796009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 432/848] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:50 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:50.813883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:50.817819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:50.818541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:50.822566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cbc39950-5a28-42e5-9e46-7bfb5574684e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085308 Sep 01 08:19:50.823296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 417/849] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:50 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:50.825539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.826081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.826598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.827354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.827860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.828340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.889587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:50.897038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6e0856a4-9e2a-4129-8977-0b097de3a8ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082962 Sep 01 08:19:50.897586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 433/850] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:50 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:50.906910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:50.907520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:50.913586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.914068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.914534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.915246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.915698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.916123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.943208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:50.943923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:50.950707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.951267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.951704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.952394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:50.952847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:50.953265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:50.979108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:50.990526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-75e819b5-d302-48eb-8435-f3f91a432b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087067 Sep 01 08:19:50.992172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 418/851] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:50 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:51.024109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:51.031652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0e1208f6-eeb1-4569-b87c-99d63bf6a17d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092230 Sep 01 08:19:51.032203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 434/852] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:50 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:51.489151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:51.489788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:51.496324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.496796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.497224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.497900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.498384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.498806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.561006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:51.568838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:51.570330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:51.571411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f1b02fe-86a9-4166-b758-4fe8483091fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086108 Sep 01 08:19:51.571950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 419/853] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:51 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:51.816591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:51.817124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:51.823523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.824002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.824430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.825111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.825552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.825962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.844047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:51.844659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:51.846746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:51.847666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=6 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:51.854002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.854515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.854950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.855642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.856091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.856514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.889216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:51.896813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfd906d7-1068-4b1d-8a8a-2be92caf9a55 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084124 Sep 01 08:19:51.897402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 435/854] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:51 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:51.916776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:51.917412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:51.920476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:51.923537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.923971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:51.924108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.924415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.925111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:51.925589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:51.926041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:51.929001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b557b32c-5f32-40cf-9247-d9e018b36aa0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089008 Sep 01 08:19:51.929616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 420/855] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:51 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:51.985830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:51.994067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b371303-71ee-4179-85bb-b6ff5702cdad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081078 Sep 01 08:19:51.994648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 436/856] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:51 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:52.012682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:52.013290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:52.019275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.019753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.020184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.020860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.021308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.021725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.052080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:52.052684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:52.059283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.059768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.060208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.060898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.061347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.061766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.083136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:52.085500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:52.091559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b9d48328-44f1-4aba-b3a5-0c46b725ba58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082314 Sep 01 08:19:52.092136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 421/857] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:52 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:52.124922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:52.132499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4c1ab780-80e7-4886-a532-0bfc85326e8a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084204 Sep 01 08:19:52.133057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 437/858] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:52 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:52.594284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:52.594884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:52.600825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.601304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.601738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.604791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.605258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.606093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.672531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:52.680390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:52.681805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:52.682905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4ab1a004-dbc7-41d9-bedb-fd2aa02f9ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092841 Sep 01 08:19:52.683454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 422/859] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:52 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:52.917791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:52.918474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:52.924780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.925195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.925633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.926349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.926803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.927225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.950350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:52.950976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:52.956969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.957452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.957883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.958601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:52.959054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:52.959471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:52.988884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:52.997205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-806dbc27-bbcb-41d3-b598-cc8f50403f22 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083762 Sep 01 08:19:52.997773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 438/860] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:52 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:53.013849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:53.014571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:53.020510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:53.020698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.021181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.021607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.022314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.022761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.023176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.029398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e916c8e4-eecb-4ad6-87de-8e6163a7a7d9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082928 Sep 01 08:19:53.030054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 423/861] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:52 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:53.084804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:53.093223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-272e632d-00c2-49a7-a7d8-6754e954a4ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083113 Sep 01 08:19:53.093777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 439/862] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:53 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:53.112662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:53.113270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:53.119929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.120413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.120846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.121530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.121981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.122436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.152802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:53.153411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:53.159344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.159835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.160259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.160944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.161396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.161813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.187489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:53.195398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-43628714-e0df-4c92-a994-aa4354483f9f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086350 Sep 01 08:19:53.196683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 424/863] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:53 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:53.224660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:53.232691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a935cc0-e1ce-444e-b8d9-8fc62f7324b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083735 Sep 01 08:19:53.233241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 440/864] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:53 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:53.705565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:53.706357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:53.712960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.713339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.713839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.714486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:53.714938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:53.715360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:53.776876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:53.785082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:53.786561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:53.787676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-147bbab1-70a7-4101-8566-adb15161ccf7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086030 Sep 01 08:19:53.788227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 425/865] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:53 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:54.018081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:54.018768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:54.026080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.026661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.027105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.027784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.028228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.028644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.032837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:54.052313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:54.052920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:54.059084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.059617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.060057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.060753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.061199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.061615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.092200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.100153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e080d909-fe9f-49ee-b18a-d514a09c8c3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085856 Sep 01 08:19:54.100984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 441/866] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:54 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:54.115847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:54.116477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:54.122848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.123330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.123756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.124521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.124887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.125306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.129916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.138965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-898f98fc-a99a-4c42-ac9e-9ad02ff70b25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090402 Sep 01 08:19:54.139769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 426/867] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:54 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:54.190473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.200766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2425f19-dad4-4f9c-9306-8e83d5c5d43c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.088673 Sep 01 08:19:54.201330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 442/868] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:54 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:54.217354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:54.217807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:54.223770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.224482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.224914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.225583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.226031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.226471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.252897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:54.253500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:54.260415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.260956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.261384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.262069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.262548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.262962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.290942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.298548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e7e77697-42f1-42e0-ae62-1c317c23c87c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085394 Sep 01 08:19:54.299272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 427/869] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:54 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:54.327718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.335206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a699778-1900-4c0d-a3d6-fc851eccdcd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086113 Sep 01 08:19:54.335767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 443/870] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:54 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:54.809275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:54.809874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:54.815805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.816280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.816706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.817388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:54.817831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:54.818246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:54.881653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.890282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.891702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:54.892784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62610d40-1c3a-44ed-87cd-b76376824d59 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087651 Sep 01 08:19:54.893333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 428/871] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:54 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:55.122246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:55.122798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:55.129344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.129824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.130253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.130965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.131411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.131826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.161546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:55.162144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:55.168230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.168712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.169175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.169865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.170336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.170757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.194479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.202744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47a8049e-f947-4c77-88f4-efe4d9d7aca8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084959 Sep 01 08:19:55.203315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 444/872] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:55 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:55.222406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:55.223016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:55.229037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.229518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.229959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.230682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.231137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.231558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.233774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.241182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5e775bfc-62c1-4afa-a454-56f3d9459ffc tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083862 Sep 01 08:19:55.241736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 429/873] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:55 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:55.291141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.298580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db91902e-95e5-4f87-81e1-fff5c419267e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080002 Sep 01 08:19:55.299140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 445/874] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:55 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:55.319219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:55.319824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:55.326357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.326839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.327269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.327947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.328394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.328867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.356599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:55.357208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:55.363170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.363656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.364090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.364778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.365231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.365653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.392341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.400169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c6ef4d7d-2813-4371-a33f-f9bbaab07e52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084678 Sep 01 08:19:55.400739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 430/875] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:55 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:55.427857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.436342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40ffbb84-5539-4dec-b573-bc97f06bce6b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083893 Sep 01 08:19:55.436910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 446/876] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:55 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:55.914706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:55.915309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:55.921911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.922437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.922858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.923560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:55.924008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:55.924425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:55.989058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.997152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.998613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:55.999704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d7ee72b-2e76-4bdf-8631-ee35c5baa3dd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088884 Sep 01 08:19:56.000486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 431/877] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:55 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:56.225098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:56.225705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:56.234314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.234520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.234835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.235544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.242015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.242015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.262408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:56.263047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:56.269167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.269757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.270244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.271035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.271572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.272061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.299695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:56.307985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f698d6f3-09ae-4a41-8793-722eb90d3f66 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086772 Sep 01 08:19:56.308638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 447/878] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:56 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:56.319010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:56.319612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:56.326207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.326725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.327155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.327843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.328288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.328705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.335957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:56.344543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9f166120-a03c-463f-83c2-2b16545cb2ea tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086331 Sep 01 08:19:56.345296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 432/879] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:56 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:56.389752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:56.397453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6fd07c05-e6dd-4bfb-adca-ddfe066047e0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082268 Sep 01 08:19:56.398005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 448/880] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:56 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:56.420741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:56.421347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:56.427305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.427786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.428219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.428901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.429350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.429774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.457019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:56.457620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:56.463868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.464351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.464785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.465531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:56.471096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:56.471708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:56.496671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:56.504341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e59699b5-6ba4-4e86-89d1-b8bfe8b634a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087437 Sep 01 08:19:56.504917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 433/881] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:56 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:56.536623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:56.545323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7b9a5717-bb00-4e8f-8327-39b6d58c194f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092158 Sep 01 08:19:56.545884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 449/882] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:56 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:57.022050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:57.022612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:57.028507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.028981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.029408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.030079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.030574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.030990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.092563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.100455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.101884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.103658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3203c49c-45c0-4cd0-83f2-952f7331a830 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084888 Sep 01 08:19:57.104209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 434/883] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:57 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:57.328737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:57.329321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:57.335300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.335774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.336197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.336878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.337387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.337886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.365619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:57.366224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:57.373464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.373947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.374408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.375194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.375655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.376071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.400914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.408550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e6396331-e85b-423e-ae21-ffc0613582bc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083470 Sep 01 08:19:57.409117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 450/884] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:57 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:57.420828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:57.421652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:57.427886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.428359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.428783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.429475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.429944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.430384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.439362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.447498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d7712459-7474-4c9a-9136-356aea65855a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085546 Sep 01 08:19:57.448071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 435/885] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:57 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:57.493083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.501551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b527d60-1962-420e-93d0-693b6413fddb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084615 Sep 01 08:19:57.502109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 451/886] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:57 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:57.525282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:57.525925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:57.531995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.532464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.532887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.533555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.534004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.536399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.566714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:57.567431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:57.573999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.574504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.574933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.575619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:57.576062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:57.576474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:57.600745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.609371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bffc9ee4-fd78-4c7e-b1a5-1b5a5b8e5091 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088311 Sep 01 08:19:57.609949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 436/887] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:57 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:57.637857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:57.645746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-00a30521-7e18-4779-b399-704abd1ee1cf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082619 Sep 01 08:19:57.646105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 452/888] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:57 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:58.125701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:58.126325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:58.132169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.132641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.133069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.133733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.134736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.135199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.153193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:58.195277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.203922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.205325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.206427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-145a8e69-be2c-425b-ab51-e16ca70a29ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084532 Sep 01 08:19:58.206969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 437/889] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:58 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:58.429099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:58.429624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:58.436420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.436896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.437325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.438016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.438493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.438910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.468912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:58.469678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:58.476150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.476709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.477216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.478661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.479108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.479530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.503904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.512540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e957d7c-caa9-4742-b215-d96c0bbf965a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086859 Sep 01 08:19:58.512743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 453/890] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:58 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:58.522662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:58.523410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:58.529794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.530291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.530731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.531422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.531872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.532285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.543850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.551430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-51937b9d-a97d-4b21-8e50-ceaa46bbabff tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086540 Sep 01 08:19:58.551985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 438/891] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:58 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:58.592642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.600226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-149e9881-4313-4c5e-9ebf-66d03a018dba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081275 Sep 01 08:19:58.600774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 454/892] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:58 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:58.629418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:58.630041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:58.637834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.638452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.638908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.639629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.640090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.640517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.666815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:58.667471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:58.673302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.673776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.674203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.674913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:58.675353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:58.675765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:58.701333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.709158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b22a15c-9a7c-455a-8e14-9c0ef9c1b317 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083511 Sep 01 08:19:58.709728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 439/893] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:58 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:58.737942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:58.746943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5da9aa20-4924-436a-abd5-de5b4df2c5ad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084525 Sep 01 08:19:58.747527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 455/894] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:58 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:19:59.230423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:59.231033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:59.237305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.237792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.238226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.238949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.239397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.240113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.301756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.309694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.311144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.312227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-970a10f5-a858-4f09-9edf-03cd5b77647d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086374 Sep 01 08:19:59.312771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 440/895] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:19:59 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:19:59.533163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:59.533887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:59.539710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.540184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.540631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.541456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.541897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.542332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.574459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:59.575079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:59.581567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.582054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.582535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.583243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.583691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.584111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.734987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.742734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93b14b71-d920-4d32-af7d-30381a2e2b2d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.213450 Sep 01 08:19:59.743299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 456/896] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:59 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:59.748456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:59.749055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:59.754996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.755481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.755910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.756597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.757042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.757459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.762099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.769707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a1643c1-b4c9-4c49-865c-3d0941ccc668 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.200580 Sep 01 08:19:59.770287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 441/897] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:59 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:59.774762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:59.775358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:59.780887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.781359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.781783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.784253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.784664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.785086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.818821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.823123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:59.828080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aca89b76-4416-4490-a861-690ffd751897 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083277 Sep 01 08:19:59.828661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 457/898] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:59 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:59.833232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:19:59.833828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:19:59.839976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.840462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.840890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.841919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:19:59.842392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:19:59.842823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:19:59.847855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.858721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28866e0a-8481-4ed5-8996-5b3f8bdac356 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087341 Sep 01 08:19:59.859294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 442/899] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:59 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:19:59.907718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:19:59.915676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0d70d13a-0480-40f3-bb80-4d4a6aa35681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085868 Sep 01 08:19:59.916257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 458/900] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:19:59 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:00.335060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:00.335688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:00.341886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.342388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.342822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.343502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.343942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.344355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.404060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:00.412125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:00.413541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:00.414653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b69a349-2d8c-46a6-8af9-085b77887c97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083427 Sep 01 08:20:00.415190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 443/901] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:00 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:00.765156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:00.765686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:00.771581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.772056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.772489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.773166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.773613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.774031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.790026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:00.790655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:00.796669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.797148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.797577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.798314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.798766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.799207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.835936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:00.844315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a052ee3-9e9f-44fc-952e-feb2ba30809e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082798 Sep 01 08:20:00.858102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 459/902] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:00 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:00.858102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:00.858102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:00.858102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.858102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.858621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.859074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.859567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.860468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.863106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:00.872281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5210bf46-4fa8-4805-b887-5588e6e969e3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086067 Sep 01 08:20:00.874990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 444/903] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:00 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:00.879707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:00.880463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:00.886804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.887288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.887724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.888444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.888895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.889315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.928509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:00.936504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd512a21-bf48-4239-ba26-89c86fd90dd2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090407 Sep 01 08:20:00.937060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 460/904] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:00 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:00.941692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:00.942303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:00.948762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.949305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.949741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.950455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:00.950907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:00.951325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:00.954923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:00.962876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3193420f-284b-4b55-8fee-3468488f6c4a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086251 Sep 01 08:20:00.963446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 445/905] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:00 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:01.012949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:01.020031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13a2df23-142d-40cb-bd57-17f4f864014a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081719 Sep 01 08:20:01.020525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 461/906] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:00 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:01.437253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:01.437995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:01.444188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.444673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.445107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.445796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.446247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.446731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.507320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:01.516121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:01.517965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:01.519104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a88fed2c-4555-4abc-a7a4-c16df5dc0b6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085768 Sep 01 08:20:01.519651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 446/907] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:01 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:01.865360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:01.865954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:01.872100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.872571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.872998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.873670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.874111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.874547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.892935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:01.893527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:01.899411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.900494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.900895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.901572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.902011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.902452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.934282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:01.942144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-57ea607d-a49f-4643-82de-a452a50a78fa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080544 Sep 01 08:20:01.942757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 462/908] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:01 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:01.956678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:01.957280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:01.963823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.964300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.964725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.965406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.965523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:01.966095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.966564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.973678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3cc07b3e-376a-422d-8c36-6152a866f0bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084620 Sep 01 08:20:01.974242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 447/909] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:01 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:01.982780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:01.983468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:01.989329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.989862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.990328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:01.991050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:01.991477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:01.991906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:02.028886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:02.036623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20364dc4-c6e4-48f1-a23c-5c84d2a5d3a5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083611 Sep 01 08:20:02.037190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 463/910] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:01 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:02.053765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:02.054179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:02.056834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:02.062314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-efa05e81-ee14-4ea4-9496-902c32b93a1f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083037 Sep 01 08:20:02.062734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:02.062903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 448/911] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:01 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:02.063290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:02.063794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:02.064529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:02.064977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:02.065397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:02.127797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:02.136631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-22c3fc1d-74c5-4a6c-adeb-4359cadb79e0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086328 Sep 01 08:20:02.137204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 464/912] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:02 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:02.542160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:02.542778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:02.548867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:02.549339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:02.549762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:02.550466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:02.550933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:02.551346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:02.616073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:02.624701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:02.626115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:02.627223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c314141f-889b-4d23-9dc4-389d45edf4e0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089542 Sep 01 08:20:02.627770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 449/913] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:02 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:02.962689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:02.963269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:02.969498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:02.969977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:02.970442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:02.971125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:02.971575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:02.971993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:02.994465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:02.995066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:03.000999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.001481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.001909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.002616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.003059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.003470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.032258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.039868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-26952c3d-13ec-452f-bcb8-ff7eb23043fc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081486 Sep 01 08:20:03.041068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 465/914] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:02 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:03.057054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:03.057660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:03.063697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.063870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.064176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.064635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.065359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.065806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.066203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.071366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f2a52f8-080e-4f0d-8349-6e45384b7987 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.080835 Sep 01 08:20:03.072438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 450/915] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:02 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:03.083551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:03.084150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:03.090676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.091411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.091836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.092524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.092991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.093381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.129774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.137903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-980d2c55-73ad-47a2-b46c-2fc133140331 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084600 Sep 01 08:20:03.138508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 466/916] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:03 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:03.156911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:03.157522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:03.158537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.163556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.164058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.164489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.165817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.166124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.166607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.166955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2245043b-4d4a-4e98-ba9a-57f5ca91743e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087068 Sep 01 08:20:03.167514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 451/917] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:03 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:03.229206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.237033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2b6bee8-21ef-48f5-abf1-d470710d9c23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083988 Sep 01 08:20:03.237604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 467/918] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:03 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:03.648953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:03.649537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:03.655541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.656017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.656445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.657118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:03.657564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:03.657979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:03.717278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.725209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.726658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:03.727875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-700a4bd2-10e0-4752-bb7b-8be019906bb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.082636 Sep 01 08:20:03.728428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 452/919] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:03 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:04.061809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:04.062443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:04.068327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.068805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.069233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.069911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.070426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.070845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.092382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:04.093075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:04.098985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.099471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.099901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.100584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.101028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.101443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.130664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.138531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-701b3662-3d54-4621-9d57-727651a348da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080567 Sep 01 08:20:04.139105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 468/920] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:04 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:04.158757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:04.159359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:04.164740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.165955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.166537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.167015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.167739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.168187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.168603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.173005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d3726ec9-4b5c-43ec-a3ee-153766d766b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084647 Sep 01 08:20:04.173646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 453/921] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:04 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:04.187414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:04.188016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:04.193685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.194158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.194620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.195299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.195739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.196160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.200539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:04.231254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.239508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-251c9c78-6802-4c24-9111-5fe59ace2c3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084483 Sep 01 08:20:04.240083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 469/922] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:04 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:04.260209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.260679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:04.261467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:04.267891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.268137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cb22e474-c680-418a-a243-7e68afa2dcaf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084358 Sep 01 08:20:04.268352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.268750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 454/923] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:04 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:04.268917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.269510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.269995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.270446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.339738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.348692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d41e6db-ceb7-4f8f-a7da-8b0cfd656745 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.093038 Sep 01 08:20:04.349270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 470/924] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:04 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:04.751137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:04.751686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:04.757621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.758093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.758566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.759378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:04.759827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:04.760238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:04.823176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.831126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.832538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:04.833615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31d94ec4-f6dd-43fb-ae8a-9e5c107d83d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087187 Sep 01 08:20:04.834162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 455/925] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:04 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:05.159196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:05.159800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:05.166590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.167077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.167493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.168168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.168615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.169027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.194708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:05.195307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:05.202474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.202951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.203374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.204056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.204498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.204911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.229442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.237079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a18909b1-5b11-428e-97bd-5b9d98e3b7dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081606 Sep 01 08:20:05.237635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 471/926] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:05 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:05.263985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:05.264592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:05.265312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.270530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.271052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.271426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.272104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.272550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.272955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.273066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a2379a5-b73c-4292-90a5-bf6e9f5a4662 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081907 Sep 01 08:20:05.273603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 456/927] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:05 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:05.293403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:05.293999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:05.299817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.300296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.300726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.301405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.301852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.302285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.333458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.342084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d36563cb-409a-4504-ac1a-aebae46a5a22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081829 Sep 01 08:20:05.342679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 472/928] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:05 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:05.365232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.370744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:05.371476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:05.373310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15a20631-58e8-4e84-a405-5d5231a03ddb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084289 Sep 01 08:20:05.374034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 457/929] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:05 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:05.377334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.377814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.378242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.378948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.379395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.379808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.441531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.449978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03df2de8-90a7-4a1d-b8d6-ec74958d18ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083008 Sep 01 08:20:05.450764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 473/930] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:05 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:05.857027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:05.857689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:05.863487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.863959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.864399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.865075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:05.865519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:05.865930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:05.928925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.937286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.938735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:05.939809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6d3ef2da-2655-4cf8-9112-369889b83287 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086685 Sep 01 08:20:05.940352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 458/931] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:05 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:06.256958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:06.257627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:06.263461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.263934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.264389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.265062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.265509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.265922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.283258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:06.293959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:06.294604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:06.300609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.301091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.301519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.302203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.302676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.303091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.326480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:06.334114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1e824baf-54db-4170-ade9-4483307588e3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080871 Sep 01 08:20:06.334600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 474/932] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:06 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:06.362947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:06.363542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:06.366876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:06.370587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.371147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.371579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.372279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.372725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.373140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.375089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-704f5e3c-3a6f-42f3-9db7-f89a95b1f42b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085370 Sep 01 08:20:06.375653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 459/933] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:06 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:06.394021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:06.394637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:06.400499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.400977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.401400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.402076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.402549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.402961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.433633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:06.441947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eb62e75b-9108-4942-ba3c-0a9eb1b4a38a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082720 Sep 01 08:20:06.451122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 475/934] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:06 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:06.465273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:06.474232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-32246f73-be56-44f7-9df1-93a8b7b0b223 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083663 Sep 01 08:20:06.474856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 460/935] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:06 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:06.477358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:06.478716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:06.485235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.485710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.486177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.486859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.487352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.487816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.551242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:06.559160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b2065ac1-0f33-4d1a-aa4a-caaacd59d7fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091249 Sep 01 08:20:06.559734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 476/936] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:06 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:06.963699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:06.964293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:06.970508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.970989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.971422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:06.972116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:06.972564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:06.972985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.035891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.044067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.045493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.046612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4c5ebc37-b46b-4bf1-a283-cda45f430196 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086914 Sep 01 08:20:07.047165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 461/937] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:06 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:07.360430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:07.361023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:07.366860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.367335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.367756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.368938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.369456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.369877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.395476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:07.396077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:07.402719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.403197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.403624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.404302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.404743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.405152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.429014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.437895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-068e12d5-f29c-490e-832c-1db37a6b8c30 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081388 Sep 01 08:20:07.438679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 477/938] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:07 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:07.462140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:07.462800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:07.464792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:07.467539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.470027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.470540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.470968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.471658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.472101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.472769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.475468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cb0ea737-fd42-4fb7-b847-358608c17fb8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083720 Sep 01 08:20:07.476026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 462/939] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:07 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:07.496945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:07.497610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:07.503600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.504256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.504686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.505371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.505812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.506223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.534725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.542494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1d05f396-ab44-435a-b5f7-25459857c0fe tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084164 Sep 01 08:20:07.543053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 478/940] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:07 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:07.569478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.577661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-87b4b9f8-9625-4ab9-b60e-1f8fc1ebdb34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085187 Sep 01 08:20:07.578444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 463/941] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:07 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:07.579384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:07.579988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:07.586086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.586615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.587058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.587743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:07.588187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:07.588600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:07.650538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:07.658653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2b86be76-90af-49c8-9548-f696e64bc64b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082943 Sep 01 08:20:07.659230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 479/942] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:07 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:08.068994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:08.069585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:08.071607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:08.076680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.077154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.077588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.078282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.078723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.079137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.141766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.150203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.151665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.152742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1f6e5eaa-464b-4a78-b034-a459ebafcef9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087600 Sep 01 08:20:08.153280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 464/943] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:08 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:08.459920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:08.460486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:08.467696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.468187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.468617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.469326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.469770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.470192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.496471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:08.497084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:08.503373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.503865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.504296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.505009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.505454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.505878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.537443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.549131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-295eb177-0105-4f0f-a33d-f7120f8afd99 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093495 Sep 01 08:20:08.549729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 480/944] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:08 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:08.564051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:08.564657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:08.574144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.575021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.575761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.577027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.577829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.578606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.582153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.592242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ad62c2a-3909-4993-b313-1d9dff2dded9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.099131 Sep 01 08:20:08.592739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 465/945] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:08 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:08.597845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:08.598472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:08.604825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.605317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.605742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.606494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.606946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.607363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.662746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.671769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1e1ba8f-c556-40cf-bdac-fca1fd36fc9e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.111601 Sep 01 08:20:08.672348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 481/946] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:08 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:08.679310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:08.680190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:08.683121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.689183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.690232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.691724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.692467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:08.692919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:08.693345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:08.693781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-699ca41a-51c7-4983-94ce-9b85b1588013 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.099509 Sep 01 08:20:08.698415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 466/947] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:08 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:08.758302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:08.767128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-898f879c-250e-4eb3-a77b-7e3613db0fc0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091295 Sep 01 08:20:08.767706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 482/948] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:08 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:09.175477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:09.176118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:09.182807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.183286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.183717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.184396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.184841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.185261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.244684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.252767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.254198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.255318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e6b98071-769d-4bd7-bb61-ee95b7b28288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083778 Sep 01 08:20:09.255863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 467/949] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:09 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:09.570107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:09.570734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:09.576849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.577421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.577846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.578497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.578949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.579365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.612952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:09.613665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:09.619615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.620176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.620683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.621462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.621983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.622510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.643709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.652877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d26f8bf-3b1d-4018-ae58-595e1d1471fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086497 Sep 01 08:20:09.653643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 483/950] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:09 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:09.683963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.692533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ea83335-ce0c-470c-b582-4b15b4875ac6 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083365 Sep 01 08:20:09.692786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:09.693102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 468/951] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:09 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:09.693317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:09.699626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.700107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.700535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.701221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.701666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.702081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.715913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:09.716532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:09.722587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.723005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.723446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.724148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.724588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.725021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.766375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.774058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e0e9d54-3e85-4f03-8676-703c97e4101a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085050 Sep 01 08:20:09.774709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 484/952] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:09 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:09.787626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:09.788494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:09.792195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.794490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.794971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.795524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.796269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:09.796720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:09.797138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:09.802710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8f6f2eea-f11d-425f-b2f5-58c90793c613 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.091731 Sep 01 08:20:09.803293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 469/953] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:09 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:09.863692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:09.872256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09d0a475-321c-4b08-bb83-8f19dc314e09 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088255 Sep 01 08:20:09.872855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 485/954] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:09 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:10.278078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:10.278705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:10.284698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.285177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.285609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.286307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.286758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.287175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.346820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.350121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:10.356220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.357626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.358757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-54b92e37-f00c-4b68-b836-470c3c9036ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085189 Sep 01 08:20:10.359301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 470/955] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:10 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:10.674030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:10.674662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:10.680538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.681050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.681482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.682164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.682647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.683067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.714491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:10.715098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:10.721265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.721830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.722176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.722888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.723327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.723743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.747238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.754975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-596645b4-d290-4ea7-90bd-9fd36c5d316d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084687 Sep 01 08:20:10.755542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 486/956] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:10 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:10.785973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.794901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb832e4c-2967-4c02-8b40-b42a8fcd1d1a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084997 Sep 01 08:20:10.795475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 471/957] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:10 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:10.796055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:10.796657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:10.802862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.803331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.803757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.804442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.804887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.805303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.823522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:10.824122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:10.830083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.830593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.831020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.831713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.832155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.832574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.890436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.898398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c10c63c2-d743-4e7c-9b04-e5d8f9818f47 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.106413 Sep 01 08:20:10.898954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 487/958] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:10 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:10.903910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:10.904502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:10.909964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.913354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.913845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.914304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.915373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:10.915831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:10.916257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:10.918009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-58803db9-cfea-494b-91b6-3ae73e07ce8e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.098920 Sep 01 08:20:10.918774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 472/959] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:10 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:10.977920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:10.986107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ea2586b-6a77-4b20-a9ff-e8808942eaae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085549 Sep 01 08:20:10.986744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 488/960] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:10 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:11.381309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:11.381901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:11.388322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.388788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.389210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.389876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.390456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.390872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.453260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:11.461334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:11.463915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:11.464989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-90910fd8-6160-4a53-8d2a-b826a95432da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087717 Sep 01 08:20:11.465538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 473/961] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:11 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:11.777067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:11.777621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:11.783527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.783998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.784420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.785086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.785525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.785936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.815923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:11.816750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:11.823756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.824239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.824671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.825369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.825818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.826237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.845653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:11.853940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1daf4997-dd05-4e96-af8f-7eb129ca5199 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080715 Sep 01 08:20:11.854540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 489/962] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:11 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:11.892130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:11.900032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-997f0840-8644-4db8-b370-8a3e29c6c4ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087780 Sep 01 08:20:11.900598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 474/963] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:11 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:11.919931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:11.920642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:11.926826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.927335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.927743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.928438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.928881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.929302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.938690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:11.939304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:11.945768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.946851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.947291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:11.947994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:11.948453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:11.948878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.000666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:12.009349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-877dd8d3-18dc-4747-a9ea-da363660e29c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.092799 Sep 01 08:20:12.010149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 490/964] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:11 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:12.014735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:12.015337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:12.021193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.021591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:12.021716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.022102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.022819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.023271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.023687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.027964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:12.029475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-378736b9-8544-44fd-b982-56360d47ed2c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094531 Sep 01 08:20:12.030156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 475/965] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:11 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:12.092000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:12.100306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd0ccb9a-cef4-4e5b-804a-54b6d953b3d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089061 Sep 01 08:20:12.100878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 491/966] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:12 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:12.487569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:12.488164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:12.494747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.495221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.495647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.496324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.496767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.497181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.559969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:12.567962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:12.569389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:12.570516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3430fe45-d106-483e-852b-52508c893734 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086796 Sep 01 08:20:12.571070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 476/967] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:12 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:12.875354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:12.875948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:12.882277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.882782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.883209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.884499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.884969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.885392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.921144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:12.921863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:12.928622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.929231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.929743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.931259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:12.931995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:12.932504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:12.951746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:12.959354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6620148d-d2af-4a8b-9f7f-e5f26edac3dc tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087714 Sep 01 08:20:12.960133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 492/968] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:12 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:12.999111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:13.007468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d39700ba-d40e-4bdf-af91-8edb47a36f52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090084 Sep 01 08:20:13.008076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 477/969] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:12 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:13.031175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:13.031814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:13.038036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.038552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.038984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.039679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.040644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.041070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.051030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:13.052068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:13.061483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.061970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.062430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.063135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.063602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.064019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.112657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:13.121590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3d5ef1d-c026-4728-9c25-4ccf8709617d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.094280 Sep 01 08:20:13.122160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 493/970] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:13 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:13.126640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:13.127185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:13.133269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.133598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.135321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.136106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.136567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.136697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:13.136995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.144355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4f90f0ab-2fbb-4f5b-869b-2616be1b9b9b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097486 Sep 01 08:20:13.144945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 478/971] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:13 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:13.307870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:13.315581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e90bf283-b968-4c95-ad3f-cb70abd4f889 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.192440 Sep 01 08:20:13.316133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 494/972] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:13 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:13.593372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:13.593969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:13.599864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.600339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.600770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.601451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.601898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.602835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.660599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:13.669204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:13.670687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:13.671772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f883d1ed-f0a4-409f-b18b-6f202c0de229 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.082658 Sep 01 08:20:13.672319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 479/973] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:13 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:13.979995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:13.980610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:13.986515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.986999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.987431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:13.988110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:13.988561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:13.988975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.028977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:14.029711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:14.035731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.036299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.036826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.037492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.037938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.038385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.048558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.057132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2b9063fa-436f-43f2-bc10-f01e0431c3ec tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080544 Sep 01 08:20:14.058075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 495/974] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:13 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:14.114924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.123075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ccdc9140-7e29-42fe-8e88-2f48240638c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.097846 Sep 01 08:20:14.123642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 480/975] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:14 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:14.142990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:14.143592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:14.150230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.150738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.151161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.151850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.152290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.152705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.166079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:14.166907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:14.172898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.173370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.173794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.174528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.174994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.175410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.217972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.225801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18e8e2a7-3bd9-46e2-aff1-8c7f47bcabe7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086550 Sep 01 08:20:14.226378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 496/976] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:14 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:14.243923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.251422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b663207-4527-444e-ac40-9228cfd23a30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.090031 Sep 01 08:20:14.251966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 481/977] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:14 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:14.337646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:14.338249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:14.344638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.345114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.345539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.346227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.346697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.347106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.411139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.419340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c718a4a1-d6b1-4963-a6bc-d4b3a5ecabcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086187 Sep 01 08:20:14.419895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 497/978] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:14 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:14.696488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:14.697159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:14.703061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.703536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.703954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.704624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:14.705073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:14.705482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:14.767620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.776100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.777542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:14.778676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-639bb557-f144-4c11-9cc7-12be5ea7fad3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086067 Sep 01 08:20:14.779216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 482/979] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:14 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:15.091828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:15.092469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:15.098628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.099112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.099550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.100277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.100698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.101124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.144304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:15.145170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:15.151229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.151786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.152290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.153050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.153571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.154079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.170026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.177728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0d93a877-afa2-4aa8-8446-e8ada71a13b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090766 Sep 01 08:20:15.178310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 498/980] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:15 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:15.216933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.224608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-db83b06a-2005-4a10-92b4-c90ec2341ae8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084203 Sep 01 08:20:15.225174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 483/981] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:15 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:15.247579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:15.248186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:15.254157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.254661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.255085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.255769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.256205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.256621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.271638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:15.272376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:15.278728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.279209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.279642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.280334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.280780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.281200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.324834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.334754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-753066d8-cc46-40ce-b943-8bac5d555b24 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.091407 Sep 01 08:20:15.335243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 499/982] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:15 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:15.351443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.360228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-976d0e30-7cac-40a9-a3e2-3cc10581f1ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092366 Sep 01 08:20:15.360982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 484/983] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:15 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:15.440629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:15.441383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:15.447647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.448127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.448559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.449262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.449708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.450136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.515306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.522941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-902c8f5c-8899-4b87-87b3-6914a1f94858 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086234 Sep 01 08:20:15.523505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 500/984] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:15 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:15.801318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:15.801916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:15.807876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.808351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.808779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.809450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:15.809897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:15.810336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:15.872879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.880762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.882170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:15.883271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-75a4f585-8028-4b0e-9afe-5816ef0dcdf9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085812 Sep 01 08:20:15.883816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 485/985] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:15 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:16.199963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:16.200538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:16.206735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.207228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.207660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.208400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.208982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.209419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.245734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:16.246713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:16.254188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.254876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.255147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.255830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.256282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.256703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.277923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.287251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cbd8e3ce-e0bf-4ecf-9c30-122e3ca03d00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.091996 Sep 01 08:20:16.288106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 501/986] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:16 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:16.322599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.330882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-238c74c0-3c28-4214-865c-74f7cf5d8d3f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089617 Sep 01 08:20:16.331712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 486/987] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:16 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:16.355898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:16.356513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:16.363049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.363596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.364037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.364742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.365199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.365747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.381381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:16.381987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:16.391231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.391717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.392138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.392825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.393267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.393710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.412697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:16.432808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.442435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e4cc49e-f247-4a25-970e-345d03bf7bf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090249 Sep 01 08:20:16.443026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 502/988] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:16 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:16.463720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.471822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-77a30d1c-13e3-4b93-9aee-00565d5ea551 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094573 Sep 01 08:20:16.472601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 487/989] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:16 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:16.544874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:16.545599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:16.551878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.552361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.552787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.553485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.553933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.554385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.618321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.627030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-567b7dea-c882-4532-b1b2-d0b099a8c866 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086856 Sep 01 08:20:16.627607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 503/990] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:16 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:16.904983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:16.905576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:16.911377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.911848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.912272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.912939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:16.913380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:16.913793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:16.973356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.981880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.983492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:16.984568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6f9fdde5-f961-4057-9c6c-aaea7ce9c1d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083523 Sep 01 08:20:16.985115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 488/991] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:16 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:17.308026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:17.308627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:17.314452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.314920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.315344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.316015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.316465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.316883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.350935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:17.351533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:17.357543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.358021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.358480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.359165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.359610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.360014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.377243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:17.385343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5dbb64c-1ae0-46f6-a96f-2e6e989e13f6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080461 Sep 01 08:20:17.385901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 504/992] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:17 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:17.424245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:17.432531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-88b6e8b7-31a0-40f0-beb8-701a842daf46 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085287 Sep 01 08:20:17.433099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 489/993] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:17 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:17.469278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:17.469891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:17.476322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.476807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.477243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.477939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.478998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.479389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.493212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:17.494677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:17.501388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.501882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.502355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.503065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.503512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.503943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.544243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:17.552186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dddef10f-b952-4380-8010-6510ca2f9796 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087028 Sep 01 08:20:17.552759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 505/994] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:17 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:17.570231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:17.579261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-35998b19-9374-4cc7-82c6-5ba13c485d7a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.090009 Sep 01 08:20:17.579843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 490/995] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:17 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:17.648159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:17.648791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:17.654966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.655455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.655882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.656579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:17.657026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:17.657440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:17.733899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:17.741787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-94e86ddb-c594-4709-9913-e62d5e784918 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.097439 Sep 01 08:20:17.742389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 506/996] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:17 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:18.005974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:18.006628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:18.013039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.013588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.013943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.014766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.015214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.015634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.083709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.093367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.095539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.096632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-94ce8cd2-600c-4183-8a6e-4ebfc37aed5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094751 Sep 01 08:20:18.097169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 491/997] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:18 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:18.406777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:18.407380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:18.413576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.414059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.414516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.415211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.415784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.416297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.454950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:18.455543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:18.461501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.461973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.462530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.463384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.463832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.464246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.480616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.484010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:18.489086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24857693-de06-46fa-8134-ccb5a2d75d5a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086203 Sep 01 08:20:18.489646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 507/998] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:18 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:18.526450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.534234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d376614b-95a5-461d-8fa1-dc051d333279 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082986 Sep 01 08:20:18.534829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 492/999] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:18 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:18.574093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:18.574769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:18.581223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.581702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.582126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.582842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.583285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.583697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.600871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:18.601484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:18.607557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.608009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.608432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.609122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.609566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.609978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.647871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.655916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d3f779f3-5f7b-4fdf-a76b-9618a91b4504 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086174 Sep 01 08:20:18.656489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 508/1000] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:18 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:18.677141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.685469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-66981d6f-35df-4fde-ad83-e144903afc40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088371 Sep 01 08:20:18.686034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 493/1001] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:18 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:18.765996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:18.766633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:18.772742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.773235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.773664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.774392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:18.775390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:18.775826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:18.853362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:18.864065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8b321690-8ff8-48b9-94ef-46929d337d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.101795 Sep 01 08:20:18.864643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 509/1002] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:18 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:19.121207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:19.121789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:19.127696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.128169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.128597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.129273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.129718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.130132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.190747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.198804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.200224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.201306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-86d26030-8094-48b9-b94f-c3f1e877cd74 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084041 Sep 01 08:20:19.201851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 494/1003] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:19 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:19.510187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:19.510832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:19.517182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.517923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.518520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.519218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.519671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.520097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.555056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:19.555658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:19.561883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.562471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.562906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.563597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.564042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.564462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.582696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.591502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4435fbfb-fd02-435f-9200-957181eb8e4e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085089 Sep 01 08:20:19.592069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 510/1004] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:19 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:19.629174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.637493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc8dfad6-f746-4d27-9949-d596306f02d1 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086056 Sep 01 08:20:19.638065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 495/1005] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:19 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:19.676641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:19.677279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:19.683475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.683960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.684392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.685089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.685591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.686094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.705966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:19.706932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:19.713418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.713902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.714364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.715051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.715759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.716182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.750551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.758390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-423b6491-6823-43b9-b0fb-090ce424f8e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085516 Sep 01 08:20:19.758949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 511/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:19 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:19.781312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.789172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fbca0464-6a5e-4f16-8929-bd99e7a65cc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087048 Sep 01 08:20:19.789730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 496/1007] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:19 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:19.885781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:19.886415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:19.892781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.893263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.893691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.894420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:19.894870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:19.895386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:19.958159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:19.966282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ef8598d6-7017-4a7e-b9f6-f8d9b7f99d7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084808 Sep 01 08:20:19.966846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 512/1008] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:19 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:20.224860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:20.225462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:20.231943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.232419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.232859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.233516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.233955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.234464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.297401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:20.305347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:20.307115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:20.308187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-38d33e03-98bc-4207-a1a2-7646aaa5c7a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087204 Sep 01 08:20:20.308727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 497/1009] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:20 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:20.612002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:20.612597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:20.618594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.619405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.619833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.620509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.620957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.621377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.658385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:20.658986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:20.664831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.665311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.665746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.666465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.666915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.667332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.682139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:20.690173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f6492a9-a192-435e-ae48-56d115c707fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081868 Sep 01 08:20:20.690777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 513/1010] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:20 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:20.728169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:20.735903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e82ec4f-a1b0-4fdd-bf31-6136c661cac4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081438 Sep 01 08:20:20.736451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 498/1011] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:20 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:20.779574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:20.780183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:20.786303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.786788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.787217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.787892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.788362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.788777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.809934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:20.810565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:20.816755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.817232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.817822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.818563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.819013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.819659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.852089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:20.860175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4f91f199-d1d2-4647-88a8-f5c90cd5095e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084355 Sep 01 08:20:20.860746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 514/1012] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:20 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:20.885844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:20.893617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d7371b3e-bcd9-4dfb-8a68-92cb14622fd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088553 Sep 01 08:20:20.894186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 499/1013] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:20 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:20.987338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:20.987863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:20.994158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.994679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.995116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:20.995816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:20.996293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:20.996715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.059830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.067481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0d59c849-3cda-4314-9240-992c899f8052 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084258 Sep 01 08:20:21.068043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 515/1014] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:20 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:21.331487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:21.332092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:21.338172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.338683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.339114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.339789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.340236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.340913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.400185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.408118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.409537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.410653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ffafbdd2-d55c-4091-b07e-14d16ed0fbbc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083005 Sep 01 08:20:21.411194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 500/1015] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:21 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:21.711327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:21.711848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:21.718437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.718906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.719335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.720006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.720449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.720862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.756751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:21.757359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:21.763539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.764021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.764451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.765169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.765591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.766008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.783872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.791944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-51fae2ba-bd70-4c2d-a7f1-9d30019d23dd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084514 Sep 01 08:20:21.792496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 516/1016] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:21 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:21.829209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.836738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b633b3da-d760-4455-bcfc-4745b2977585 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083825 Sep 01 08:20:21.837992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 501/1017] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:21 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:21.881582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:21.882188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:21.888723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.889204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.889635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.890356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.890805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.891224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.915099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:21.916057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:21.922303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.922787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.923216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.923896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:21.924339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:21.924758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:21.970047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.977992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf8ceeef-6982-446c-a1b8-44c809c58d3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.100093 Sep 01 08:20:21.979326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 517/1018] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:21 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:21.989662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:21.997512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f47f2bf7-738d-4cc9-9c17-af4492900aed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086188 Sep 01 08:20:21.998071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 502/1019] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:21 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:22.089888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:22.090801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:22.097222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.097704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.098159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.099065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.099347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.099761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.164007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:22.172489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ed33a3e-c6a9-43b8-a1d1-cd504d2813a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087493 Sep 01 08:20:22.173066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 518/1020] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:22 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:22.432866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:22.433500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:22.439439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.439917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.440347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.441028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.441536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.441957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.502414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:22.510392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:22.511828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:22.512922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cf357ff4-654a-47be-8c27-85b3057c521b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084009 Sep 01 08:20:22.513477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 503/1021] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:22 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:22.813394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:22.813999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:22.819938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.820416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.820850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.821533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.821987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.822483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.858996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:22.859599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:22.866320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.866807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.867236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.867928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:22.868374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:22.869348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:22.873737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:22.886907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:22.894661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f93b7f74-e7b6-4dba-bce3-7b2f1c70e8d5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085093 Sep 01 08:20:22.895447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 519/1022] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:22 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:22.935086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:22.942552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26521d52-3852-4785-abde-485e35db1942 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087243 Sep 01 08:20:22.943109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 504/1023] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:22 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:22.998763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:22.999366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:23.005494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.005973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.006430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.007116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.007558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.007975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.019248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:23.019887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:23.026687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.027176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.027604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.028301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.028758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.029174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.080620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:23.088781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38c84a61-4a4a-4321-989f-10a96e086d4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.093778 Sep 01 08:20:23.098237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 520/1024] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:22 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:23.101046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:23.109268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-816c5a87-0462-4e36-b27e-9c8b3c00deae tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.093726 Sep 01 08:20:23.109828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 505/1025] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:23 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:23.194363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:23.194975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:23.202238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.202770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.203205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.203911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.204359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.204827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.270698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:23.278588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-51f3c1eb-0dac-4f09-a2b6-f582a69749b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088207 Sep 01 08:20:23.279246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 521/1026] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:23 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:23.535817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:23.536468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:23.543011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.543486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.543917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.544595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.545041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.545462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.605231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:23.613188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:23.614650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:23.615736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d0a60162-1e74-4f66-aa3f-0a2bc7e4a891 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.083834 Sep 01 08:20:23.616288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 506/1027] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:23 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:23.915428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:23.916116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:23.921904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.922417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.922850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.923533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.923976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.924396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.962809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:23.963575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:23.969925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.970445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.970907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.971601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:23.972046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:23.972468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:23.984177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:23.991776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3dc27702-3f49-42e5-b308-9eaa906b4764 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080187 Sep 01 08:20:23.992341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 522/1028] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:23 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:24.032479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:24.040078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c8efb6e8-ba6b-4b97-85fc-2d8fea9b9cc4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081091 Sep 01 08:20:24.040623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 507/1029] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:23 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:24.110354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:24.110959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:24.116935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.117412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.117841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.119166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.119760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.120182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.130216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:24.130845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:24.136943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.137419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.137843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.138560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.139003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.139418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.191664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:24.205409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ab42e7e-bc18-45aa-bf15-f7c0444f4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.098539 Sep 01 08:20:24.206463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 523/1030] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:24 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:24.225099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:24.233459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4442534c-0480-46b4-a49d-17ed991b8165 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.107026 Sep 01 08:20:24.234049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 508/1031] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:24 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:24.299194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:24.299808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:24.305929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.306640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.307251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.307964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.308418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.308837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.328609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:24.373075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:24.380813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-62f94ef5-503b-443d-9957-ca98d8eb6663 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085558 Sep 01 08:20:24.381372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 524/1032] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:24 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:24.640563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:24.641174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:24.647068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.647537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.647957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.648625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:24.649064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:24.649477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:24.708549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:24.716826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:24.718241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:24.719334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f712860-e9b2-448c-a270-14d885dedaff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.082759 Sep 01 08:20:24.719871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 509/1033] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:24 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:25.012635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:25.013232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:25.019280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.019765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.020197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.020886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.021333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.021757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.061343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:25.062025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:25.067939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.068421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.068873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.069563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.070013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.070459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.090758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.098591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-22e6ec90-a3c8-42f6-876a-dd2325cc9cb7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089665 Sep 01 08:20:25.099150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 525/1034] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:25 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:25.138972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.146477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0116c0be-b0ab-4d60-ad6f-842480aa0213 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089272 Sep 01 08:20:25.147030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 510/1035] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:25 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:25.235143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:25.235742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:25.241775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.242296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.242708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.243904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.244416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.244873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.253171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:25.253782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:25.261023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.261521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.261957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.262754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.263140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.263562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.313224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.322479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-424bf6fb-9e85-40ad-a54f-45cd924d2505 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090399 Sep 01 08:20:25.323061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 526/1036] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:25 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:25.339435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.347370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3b1ba47c-b010-4183-b823-2eb7e275ae41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.098042 Sep 01 08:20:25.347931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 511/1037] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:25 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:25.403787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:25.404392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:25.410544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.411023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.411552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.412136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.412587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.413000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.476456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.484973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f0d76ba2-8a24-40a5-8bc2-23378ef949e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086653 Sep 01 08:20:25.485545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 527/1038] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:25 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:25.744704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:25.745299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:25.751343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.751827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.752258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.752954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:25.753494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:25.753844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:25.817263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.825582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.827023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:25.828138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a5c10ce-13ef-4e44-a199-4db2942d78d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088047 Sep 01 08:20:25.828705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 512/1039] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:25 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:26.120150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:26.120750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:26.122580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:26.127760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.128229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.128656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.129328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.129770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.130182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.167394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:26.168023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:26.174090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.174605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.175034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.175724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.176173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.176584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.190917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.198312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a6d6b9ed-85dc-4d0f-a564-bad6fb122b92 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081978 Sep 01 08:20:26.198867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 528/1040] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:26 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:26.241900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.249454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb5860a6-f592-4b35-bae8-109116e664ec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086444 Sep 01 08:20:26.250000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 513/1041] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:26 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:26.347940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:26.348856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:26.357360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.357843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.358328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.359020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.359462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.359875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.369451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:26.370101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:26.372003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:26.377500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.377987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.378466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.380397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.380397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.380397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.423723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.442081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85dc042c-1aef-42e0-82ec-25e1be65b3f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.101178 Sep 01 08:20:26.443607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 529/1042] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:26 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:26.476423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.489601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b0ebde6c-ae2b-419a-8575-e89d5f0669bd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.124097 Sep 01 08:20:26.490721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 514/1043] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:26 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:26.506865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:26.507479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:26.513743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.514227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.514704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.515405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.515857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.516282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.584335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.594074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0849f06e-0ebd-4be6-90d7-912f02465598 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091116 Sep 01 08:20:26.594699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 530/1044] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:26 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:26.851227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:26.851832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:26.858597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.859071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.859503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.860192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:26.860633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:26.861047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:26.920482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.928367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.929775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:26.930878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1dd3f977-e3ce-42d5-a8f1-b5a1a8618ff4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.084219 Sep 01 08:20:26.931424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 515/1045] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:26 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:27.220119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:27.220866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:27.227313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.227832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.228424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.229109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.229550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.230160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.269469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:27.270227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:27.277571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.278194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.278764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.279697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.280281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.280831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.291045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:27.298659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a7edc5c-b8b6-4cb5-8173-21ec707856e5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082613 Sep 01 08:20:27.299386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 531/1046] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:27 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:27.344160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:27.351734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-950b784d-a798-469d-a319-35668408feed tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086047 Sep 01 08:20:27.352287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 516/1047] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:27 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:27.467866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:27.468587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:27.474585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.475064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.475494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.476180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.476624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.477038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.512161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:27.512770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:27.519285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.519499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.519892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.520598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.521052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.521465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.543021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:27.548844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3604a9e-88a3-4d32-a544-08ff23c13bc9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084996 Sep 01 08:20:27.549509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 532/1048] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:27 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:27.586682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:27.596764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f4943385-610b-4d44-9116-5c4cc784bf37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089056 Sep 01 08:20:27.597350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 517/1049] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:27 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:27.614924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:27.615530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:27.621797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.622297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.622733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.623423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.623867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.624280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.687261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:27.695335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bbbe5a16-e481-4545-833a-99f57ccfce1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084180 Sep 01 08:20:27.695915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 533/1050] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:27 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:27.953560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:27.954161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:27.960066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.960536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.960962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:27.961630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:27.962107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:27.963083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.023479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.032654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.034084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.035331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-821c0128-7072-4756-a8a9-0487631867b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085593 Sep 01 08:20:28.035884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 518/1051] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:27 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:28.319043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:28.319645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:28.326133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.326638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.327069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.327754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.328199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.328619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.372514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:28.373110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:28.379015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.379495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.381088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.381789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.382231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.382746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.388272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.395952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-539315d6-c072-41ac-b927-610f390c9d6e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080815 Sep 01 08:20:28.396503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 534/1052] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:28 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:28.443338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.451682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c05a8c42-e502-461a-995e-f280cc374da4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083643 Sep 01 08:20:28.452230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 519/1053] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:28 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:28.570896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:28.571533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:28.578072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.578584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.579008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.579690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.580127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.580536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.616941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:28.617554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:28.624713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.625196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.625630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.626364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.626818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.627241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.641716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.649382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4fe4ab20-6db7-4c75-ae85-8976ce195569 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082271 Sep 01 08:20:28.650037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 535/1054] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:28 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:28.693777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.697285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:28.702844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-affabdb6-868c-44bf-b75f-50be5fa6408d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089675 Sep 01 08:20:28.703418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 520/1055] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:28 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:28.716450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:28.717274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:28.723756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.724154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.724599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.725306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:28.725756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:28.726212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:28.899688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:28.908062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b7c57803-f552-45a8-84e6-26166d5c0102 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.195776 Sep 01 08:20:28.908623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 536/1056] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:28 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:29.058978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:29.059826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:29.065797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.066303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.066739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.067436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.067885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.068309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.130308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:29.138847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:29.140264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:29.141398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31f01e72-6c07-44dd-8afd-78c8b217d57f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086989 Sep 01 08:20:29.141930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 521/1057] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:29 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:29.416749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:29.417304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:29.423239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.423714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.424152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.424829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.425283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.425707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.472211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:29.472747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:29.478863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.479419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.479948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.480637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.481088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.481507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.486455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:29.494195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd0e0740-7d4c-4ff5-88da-42370429a7f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081352 Sep 01 08:20:29.494787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 537/1058] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:29 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:29.541986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:29.549514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7783ce67-72f6-4559-9feb-06dedd3a2a52 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081362 Sep 01 08:20:29.550064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 522/1059] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:29 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:29.670503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:29.671024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:29.676868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.677333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.677756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.678463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.678909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.679319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.724927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:29.725531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:29.731568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.732050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.732483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.733170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.733618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.734038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.742145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:29.750514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d8524d29-8fc1-47c5-bee3-b99ce2177cc3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084050 Sep 01 08:20:29.751074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 538/1060] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:29 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:29.793919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:29.801628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3750e28b-3f10-4da6-ad62-66167b99f4dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080593 Sep 01 08:20:29.802178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 523/1061] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:29 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:29.928980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:29.929493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:29.936447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.936933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.937363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:29.938235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:29.938563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:29.938987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.001204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.009708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3eff0515-cd03-4a80-bb92-938fcc0b7aef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084019 Sep 01 08:20:30.010322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 539/1062] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:29 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:30.164365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:30.164984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:30.171728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.172241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.172672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.173397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.173844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.174284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.237569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.246511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.247926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.249015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a58eb86-7318-42b2-a4fa-f13121db5b56 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088575 Sep 01 08:20:30.249564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 524/1063] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:30 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:30.514732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:30.515343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:30.521513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.521987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.522465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.523145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.523594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.524046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.570389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:30.571110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:30.577352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.577925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.578459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.579228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.579769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.580264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.586342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.595041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d5952cda-cd0d-44b0-b95c-67a1aa9a9f76 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084085 Sep 01 08:20:30.595610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 540/1064] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:30 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:30.640449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.647939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5e8f0438-8383-41e6-a0b7-73ee8f03efc0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081412 Sep 01 08:20:30.648504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 525/1065] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:30 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:30.772121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:30.772644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:30.779250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.779719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.780142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.780815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.781256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.781675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.785612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:30.824376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:30.825000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:30.830929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.831410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.831846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.832537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:30.832986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:30.833410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:30.842570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.850271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-076dce21-c128-4e3f-8ae1-1fe7af01798e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081941 Sep 01 08:20:30.850880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 541/1066] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:30 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:30.893745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:30.903371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f48ebd5c-cc90-483a-aac3-af17b81224e8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083515 Sep 01 08:20:30.904373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 526/1067] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:30 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:31.031824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:31.032426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:31.038452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.038926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.039350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.040037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.040477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.040889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.104303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:31.112232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0be58842-b5ae-4c16-a28b-e3e3139632d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084300 Sep 01 08:20:31.112839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 542/1068] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:31 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:31.271515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:31.272116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:31.278104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.278676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.279113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.279810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.280260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.280690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.344766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:31.353290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:31.354756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:31.355858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e99deedd-e2b1-45ab-bce0-ee25617c7c1a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088243 Sep 01 08:20:31.356608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 527/1069] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:31 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:31.616241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:31.616767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:31.623233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.623707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.624142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.624816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.625263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.625678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.668788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:31.669496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:31.675384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.675861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.676541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.676976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.677421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.677836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.685880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:31.693397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33899068-2387-47b1-afdc-42889d89e2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081027 Sep 01 08:20:31.693954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 543/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:31 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:31.742142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:31.750801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f2e0739e-e9c3-43e8-9d90-02244bc86bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085741 Sep 01 08:20:31.751371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 528/1071] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:31 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:31.870242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:31.870804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:31.877260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.877734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.878160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.878886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.879316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.879735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.928995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:31.929734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:31.936507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.937086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.937615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.938452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:31.938977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:31.939522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:31.941863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:31.949504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d0557103-387d-4a3e-a77d-c2e60b08af07 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083109 Sep 01 08:20:31.950171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 544/1072] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:31 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:32.000079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:32.007878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9077f2c8-9f6d-4a43-8a4d-bc93062d7b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082795 Sep 01 08:20:32.008442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 529/1073] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:31 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:32.132959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:32.133478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:32.140507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.140985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.141418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.142107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.142585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.143007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.212493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:32.220813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f60cb907-d583-4301-afaf-f923c42a85db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091689 Sep 01 08:20:32.221662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 545/1074] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:32 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:32.378731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:32.379339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:32.385927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.386357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.386839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.388427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.388932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.389396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.455762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:32.463986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:32.466081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:32.467218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c8af1c48-4bea-4393-98d3-edf235f74a37 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092646 Sep 01 08:20:32.467979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 530/1075] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:32 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:20:32.714658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:32.715574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:32.721215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.721691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.722121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.722822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.723270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.723688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.771826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:32.772433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:32.778372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.778853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.779283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.779965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.780411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.780854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.788160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:32.796358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed1f0cde-0b58-4e02-be10-0e45056b56bd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085547 Sep 01 08:20:32.796924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 546/1076] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:32 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:32.845218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:32.852743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-163fe999-e0f5-4d3b-92ee-b2d623268713 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084697 Sep 01 08:20:32.853298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 531/1077] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:32 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:32.970877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:32.971393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:32.977689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.978161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.978623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:32.979308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:32.979753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:32.980174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.029107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:33.029738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:33.035666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.036143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.036579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.037290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.037711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.038131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.039946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.047727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d1440eb-c86b-410f-8494-8125f494982f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080651 Sep 01 08:20:33.048295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 547/1078] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:32 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:33.099043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.106846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6fac6e0b-b3cc-4fab-bf0a-9c4e4e94ee85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082293 Sep 01 08:20:33.107402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 532/1079] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:33 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:33.241092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:33.241605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:33.248326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.248806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.249232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.249923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.250399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.250815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.313499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.321115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-56175294-c022-4160-86fd-3ba6b579a6b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083901 Sep 01 08:20:33.321678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 548/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:33 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:33.489072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:33.489733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:33.496992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.497557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.498008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.498728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.499166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.499579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.561795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.569969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.571431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.572565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e641ec6-b061-4d92-8fe5-add6318661b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087385 Sep 01 08:20:33.573122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 533/1081] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:33 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:33.819332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:33.819933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:33.826040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.826541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.826969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.827658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.828106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.828523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.873385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:33.874000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:33.879993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.880473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.880930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.881620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:33.882065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:33.882518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:33.891199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.898779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d15e35d4-25ee-431f-887d-3c3112ccf300 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083378 Sep 01 08:20:33.899336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 549/1082] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:33 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:33.943952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:33.952005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b15415f8-78a6-4e06-be07-fe034a7269d3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083004 Sep 01 08:20:33.952562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 534/1083] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:33 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:34.068473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:34.069068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:34.075637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.076182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.076615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.077288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.077730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.078147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.128136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:34.128737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:34.134668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.135149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.135581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.136266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.136721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.137131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.140952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:34.148472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3df7996c-8e20-437f-98f5-1633d041ac80 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083791 Sep 01 08:20:34.149042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 550/1084] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:34 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:34.197778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:34.205382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-50a38a1b-f439-429f-808a-213fa9e29287 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081100 Sep 01 08:20:34.205942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 535/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:34 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:34.343234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:34.343779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:34.349760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.350296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.350709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.351387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.351827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.352261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.413140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:34.421770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c470b770-0be6-47b5-b113-23acdb2e1717 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082797 Sep 01 08:20:34.422362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 551/1086] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:34 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:34.596719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:34.597263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:34.603417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.603905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.604375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.605104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.605553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.605974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.678370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:34.686905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:34.688330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:34.689421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e154e29c-ff07-4327-b883-2eefcd1b7a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.096809 Sep 01 08:20:34.689966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 536/1087] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:34 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:34.922736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:34.923270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:34.929217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.929689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.930112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.930832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.931267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.931679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.972414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:34.973015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:34.979439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.979918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.980349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:34.981611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:34.982332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:34.982894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.001372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.003317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:35.009283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1a9a0112-7dcf-4125-9c87-b58d426123d8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090925 Sep 01 08:20:35.009847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 552/1088] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:34 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:35.048868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.056620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3394b27e-68b2-4695-89f1-38bc47e5aef7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.088045 Sep 01 08:20:35.057174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 537/1089] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:34 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:35.169688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:35.170420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:35.176776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.177263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.177692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.178416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.178859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.179269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.226056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:35.226826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:35.233639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.234122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.234578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.235269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.235726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.236146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.241138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.250430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8fb2de82-0e61-491c-a1fa-4474a633b223 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085067 Sep 01 08:20:35.251058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 553/1090] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:35 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:35.300185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.310453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1e5ec3c-2a6d-4126-b9a8-75dac37a9f1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088188 Sep 01 08:20:35.311027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 538/1091] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:35 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:35.445423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:35.448001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:35.457101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.457974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.458804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.460136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.460937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.461714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.554844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.563061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-398d8731-5c34-47f2-af22-5464414a16f4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.123746 Sep 01 08:20:35.563818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 554/1092] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:35 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:35.714186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:35.714852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:35.722155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.722671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.723108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.723821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:35.724268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:35.724691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:35.804022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.819535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.822270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:35.824361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f22987b-80d0-4020-ab9a-df649be18021 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.113916 Sep 01 08:20:35.826609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 539/1093] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:35 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:36.031965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:36.032563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:36.038404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.038877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.039302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.039971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.040411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.040821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.076650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:36.077245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:36.083431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.083900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.084325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.085009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.085451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.085862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.101595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.110405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-832b0df8-68aa-4e49-a3cd-2eace5e60faa tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082497 Sep 01 08:20:36.110867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 555/1094] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:36 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:36.148588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.157201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d566c1e-ad81-4ce6-abc3-89ec5771cc4a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084312 Sep 01 08:20:36.157759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 540/1095] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:36 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:36.272103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:36.272731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:36.279436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.279915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.280347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.281034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.281693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.282493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.336733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:36.337371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:36.344290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.344766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.345191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.345881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.346343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.346762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.348072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.356609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2fbfee8f-6b84-4a71-a3ca-c552f6022c22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087744 Sep 01 08:20:36.357274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 556/1096] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:36 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:36.421305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.428949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ca942c11-231a-4768-aebe-f6696c678e6d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096024 Sep 01 08:20:36.429552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 541/1097] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:36 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:36.587428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:36.588208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:36.596694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.597370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.597979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.599017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.599660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.600251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.676941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.680331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:36.686194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0e07fb4-a8cd-4edd-b1ac-28eb97251c93 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.104652 Sep 01 08:20:36.686810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 557/1098] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:36 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:36.851616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:36.852238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:36.858566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.859048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.859498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.860179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:36.860628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:36.861052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:36.944699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.953837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.955306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:36.956397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fd4ffdce-8f36-4e71-a985-1dc9058638da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.110974 Sep 01 08:20:36.956953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 542/1099] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:36 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:37.131455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:37.131997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:37.138897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.139394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.139802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.140486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.140959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.141372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.182837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:37.183471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:37.190517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.191000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.191420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.192109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.192652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.193069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.209619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:37.217660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-477f9a34-f629-40ca-a3db-c0c7ebb49459 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090677 Sep 01 08:20:37.218386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 558/1100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:37 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:37.254565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:37.262050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-98bf490d-ba3b-453c-944e-4a8e216dd372 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083013 Sep 01 08:20:37.262723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 543/1101] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:37 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:37.378052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:37.378690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:37.384735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.385146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.385569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.386349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.386794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.387292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.451086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:37.451766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:37.452960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:37.460981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.461470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.461594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-35e40a83-0098-4b69-b7f0-ac737036e8bd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087643 Sep 01 08:20:37.461895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.462111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 559/1102] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:37 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:37.462660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.463106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.463685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.537449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:37.545609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bc504a02-5f1e-4137-ba3b-7f2518c593ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.098826 Sep 01 08:20:37.546176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 544/1103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:37 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:37.720332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:37.720846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:37.726742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.727215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.727643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.728316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.728760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.729203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.793651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:37.801631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf065a41-275a-4335-bcb9-be8641a51c75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085184 Sep 01 08:20:37.802204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 560/1104] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:37 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:37.979280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:37.979834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:37.986384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.986861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.987287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:37.987979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:37.988419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:37.988857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.062811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.071244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.072679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.073786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-de1920b7-8b08-4a1a-9ead-e68441682ce6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.098517 Sep 01 08:20:38.074362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 545/1105] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:37 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:38.240990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:38.241534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:38.248490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.248966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.249394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.250097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.250575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.250988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.290690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:38.291299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:38.298016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.298537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.298966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.299652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.300094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.300508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.310688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.318165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7c46196b-9706-477a-bb15-e430c6bfb9e6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081151 Sep 01 08:20:38.319110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 561/1106] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:38 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:38.361629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.369070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-152c2151-2942-4e40-b3db-9987bef6835d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082166 Sep 01 08:20:38.369623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 546/1107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:38 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:38.483356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:38.483957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:38.489749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.490217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.490674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.491396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.491788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.492203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.555224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.563330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6c91a04c-6630-4c40-9aec-c602247a1ca2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084503 Sep 01 08:20:38.563897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 562/1108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:38 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:38.566334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:38.566945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:38.572869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.573348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.573780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.574490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.574985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.575440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.636506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.644672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9a39fef-34a4-4429-ac1c-cf9d1d18b1e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082260 Sep 01 08:20:38.645223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 547/1109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:38 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:38.823031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:38.823634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:38.830438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.830909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.831334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.832006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:38.832450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:38.832864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:38.892780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:38.900623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5c45fb65-8a81-4ed9-8dfd-7e63ffee9675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081346 Sep 01 08:20:38.901193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 563/1110] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:38 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:39.097074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:39.097611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:39.103754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.104236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.104655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.105344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.105889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.106407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.169347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:39.177665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:39.179127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:39.180223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-52cf75b0-bb70-4f15-ad75-fada9ce39409 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087122 Sep 01 08:20:39.180768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 548/1111] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:39 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:39.339208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:39.340060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:39.346657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.347198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.347580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.348267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.348715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.349137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.389393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:39.390003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:39.395940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.396426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.396857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.397552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.398006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.398453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.413743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:39.422403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dcaa5c46-0ca6-46df-b628-cce9c29f596a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087048 Sep 01 08:20:39.422976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 564/1112] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:39 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:39.460148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:39.468291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9aa3f3f7-9d24-4850-8cba-6958a73fae6a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083245 Sep 01 08:20:39.469443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 549/1113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:39 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:39.584154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:39.584776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:39.591373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.591876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.592311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.593018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.593465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.593882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.654297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:39.662342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b721d9a7-ea96-4c71-bc79-3cd3838d9f5f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081672 Sep 01 08:20:39.662595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 565/1114] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:39 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:39.664949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:39.665593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:39.672040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.672519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.672952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.673636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.674086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.674535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.734320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:39.741717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4dfeccbc-b778-48ac-849a-bb9024e0e82d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080698 Sep 01 08:20:39.742281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 550/1115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:39 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:39.923176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:39.923689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:39.929660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.930140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.930596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.931270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:39.931709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:39.932121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:39.993723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.002231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c1f1eead-eeea-4894-8c89-b232963cfb75 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083937 Sep 01 08:20:40.002834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 566/1116] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:39 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:40.203472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:40.204046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:40.209997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.210507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.210938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.211632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.212076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.212496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.278040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.286088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.287560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.288640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dfe88f7e-7874-46db-9fed-fbacb6452844 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089936 Sep 01 08:20:40.289180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 551/1117] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:40 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:40.443225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:40.443831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:40.449752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.450367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.450805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.451489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.451938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.452358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.489552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:40.490228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:40.496251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.497355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.497780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.498488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.498940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.499339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.512702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.521132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8452bca1-70b9-4d87-957c-a9196c54ae9e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081631 Sep 01 08:20:40.521700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 567/1118] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:40 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:40.560805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.568477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4130b72b-38ad-4020-b844-064366671889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082639 Sep 01 08:20:40.569041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 552/1119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:40 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:40.683045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:40.683650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:40.689639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.690110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.690571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.691252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.691698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.692117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.754030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.761623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ba11a3d4-2aa6-4edb-90b8-a511293678ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082357 Sep 01 08:20:40.763055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 568/1120] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:40 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:40.763359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:40.763969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:40.770962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.771433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.771856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.772545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:40.772988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:40.773400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:40.832419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:40.840182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fd45f16c-ed08-4e0e-b405-d563bc568b37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081069 Sep 01 08:20:40.840733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 553/1121] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:40 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:41.022619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:41.023152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:41.029404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.029881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.030371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.031031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.031479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.031900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.092349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.099915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7829154-c74d-4314-bc53-19a226f88ae5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081229 Sep 01 08:20:41.100488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 569/1122] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:41 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:41.312190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:41.312893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:41.319053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.319543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.319981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.320685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.321139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.321571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.326434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:41.386668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.395410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.396846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.397948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9e816b23-a749-4639-ae6c-457b2b273567 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090198 Sep 01 08:20:41.398516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 554/1123] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:41 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:41.549938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:41.550578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:41.557045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.557556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.557986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.558719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.559693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.560117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.590730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:41.591402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:41.597232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.597742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.598179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.598901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.599350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.599763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.629858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.638489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5e7de28e-f2a1-4143-a61e-d7b873ae2a71 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092337 Sep 01 08:20:41.639246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 570/1124] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:41 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:41.661740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.669559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-07c5ef7e-65bc-4f0b-8a13-491d4a8e7b65 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083426 Sep 01 08:20:41.670111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 555/1125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:41 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:41.784975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:41.785574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:41.791442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.791911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.792334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.793005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.793509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.793919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.853302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.860935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:41.861141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1286a73a-5cd3-4d14-acfb-7cb7a83a7538 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079930 Sep 01 08:20:41.861804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:41.861936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 571/1126] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:41 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:41.867681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.868158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.868592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.869276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:41.869728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:41.870150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:41.929679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:41.937437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4558073-fc61-4a13-b1da-3519acc1a1ee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080297 Sep 01 08:20:41.937989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 556/1127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:41 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:42.122144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:42.122715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:42.128633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.129105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.129533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.130214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.130682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.131098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.192189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:42.200384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-167acf46-8bcc-4539-8f2c-c9260e42cb29 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081997 Sep 01 08:20:42.200946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 572/1128] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:42 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:42.420544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:42.421135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:42.427214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.427692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.428118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.428805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.429253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.429739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.497964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:42.506733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:42.508161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:42.509255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4818dedc-f03f-4a15-9aac-db81284c01c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.093413 Sep 01 08:20:42.509818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 557/1129] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:42 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:42.658888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:42.659489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:42.665258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.665727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.666154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.666848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.667296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.667705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.689449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:42.689971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:42.695729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.696217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.696626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.697298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.697742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.698153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.727584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:42.735773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3172131c-3af5-44e8-9118-e1f5018b8781 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080534 Sep 01 08:20:42.736614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 573/1130] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:42 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:42.757488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:42.765171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-883208ea-79ba-4f7a-98dc-f4967cfefb3d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.079586 Sep 01 08:20:42.765723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 558/1131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:42 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:42.881569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:42.882381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:42.888291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.888766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.889197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.889904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.890386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.890806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.908694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:42.954530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:42.958277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:42.958892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:42.963870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-863f76af-1eea-4055-a589-9d3abd55b0e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086059 Sep 01 08:20:42.964443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 574/1132] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:42 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:42.966747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.967238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.967674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:42.968379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:42.968828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:42.969249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.029262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:43.036816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-177f05f3-2c6e-4809-b6c8-b64d8813a331 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082397 Sep 01 08:20:43.037374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 559/1133] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:42 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:43.221383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:43.221915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:43.228181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.228626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.229054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.229731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.230178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.230619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.290895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:43.301422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7b23655f-d023-4c11-ad92-b8551c0fe780 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083743 Sep 01 08:20:43.302202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 575/1134] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:43 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:43.533292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:43.533898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:43.540171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.540653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.541081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.541772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.542213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.542656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.611984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:43.620753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:43.622785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:43.623890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-406ae865-ed13-4733-9569-4318a52b1295 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094885 Sep 01 08:20:43.624477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 560/1135] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:43 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:43.756948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:43.757506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:43.764094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.764566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.764992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.765671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.766116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.766573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.784711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:43.785397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:43.791254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.791721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.792151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.792831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.793337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.793926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.837704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:43.845901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7bb0e9fa-8706-4de1-8334-623fd39c93f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092749 Sep 01 08:20:43.846493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 576/1136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:43 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:43.857485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:43.864910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-670053bd-6acf-49cf-ad52-fb2d5229dc97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083960 Sep 01 08:20:43.865462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 561/1137] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:43 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:43.985859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:43.986501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:43.992413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.992887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.993314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:43.993990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:43.994471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:43.994892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.055059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.057895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:44.058524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:44.063231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03e75b5b-5d48-4a51-bdf5-866455a3aa03 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081228 Sep 01 08:20:44.063792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 577/1138] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:43 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:44.065270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.065746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.066168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.066879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.067323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.067739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.128335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.135744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b40f37b-8b22-480b-a34e-ddc706453530 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081563 Sep 01 08:20:44.136291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 562/1139] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:44 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:44.325133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:44.325639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:44.327526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:44.332720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.333189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.333620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.334313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.334759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.335173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.397865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.405393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb85d6c4-1541-40ad-a43b-cafe8b14a8ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084261 Sep 01 08:20:44.405940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 578/1140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:44 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:44.647212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:44.647748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:44.653823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.654330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.654764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.655456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.655898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.656317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.718427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.726665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.728085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.729193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6abfad3c-684a-44b3-9320-9925ec4afc70 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085962 Sep 01 08:20:44.729734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 563/1141] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:44 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:44.867321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:44.867962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:44.874708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.875186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.875616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.876294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.876745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.877166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.884735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:44.885462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:44.887346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:44.892584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.893068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.893501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.894191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:44.894671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:44.895412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:44.940779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.948518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-495f79e2-4e33-456d-82f0-8c6e19cf827d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084859 Sep 01 08:20:44.949128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 579/1142] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:44 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:44.968609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:44.976668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c206f026-41e1-4ea9-b27b-daf8148abbca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.095752 Sep 01 08:20:44.977429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 564/1143] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:44 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:45.084919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:45.085516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:45.092996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.093451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.094671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.095120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.095693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.157524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:45.158244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:45.164267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.164481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:45.164743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.165174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.165867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.166343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.166763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.172890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ff6b8d2a-834d-4a93-a836-77faa8a7b30d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.091774 Sep 01 08:20:45.173624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 580/1144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:45 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:45.230651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:45.238918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-203f44a6-7efb-4491-b2c0-1e12f0c9c45f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085356 Sep 01 08:20:45.239474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 565/1145] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:45 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:45.426168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:45.426803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:45.432713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.433180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.433604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.434332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.434775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.435189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.495166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:45.502830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4698a60e-0540-4cbd-ae67-935522bb449d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080436 Sep 01 08:20:45.503385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 581/1146] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:45 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:45.752964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:45.753507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:45.759466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.759938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.760362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.761046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.761490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.761933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.826194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:45.834667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:45.835967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:45.837053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b52100a4-73fd-42e3-92a8-360221ecd142 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088101 Sep 01 08:20:45.837598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 566/1147] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:45 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:45.970016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:45.970650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:45.976836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.977309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.977733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.978447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:45.978892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:45.979305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:45.999018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:45.999720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:46.005672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.006091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.006549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.007363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.007834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.008289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.039309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.047092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b91aab0a-6a88-4cd6-b081-5c687520643d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080876 Sep 01 08:20:46.047656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 582/1148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:45 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:46.070885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.079012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d3f305dd-a177-4023-a089-c3085747ccac tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084554 Sep 01 08:20:46.079560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 567/1149] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:45 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:46.193432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:46.194034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:46.200004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.200499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.200926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.201611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.202643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.202643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.259592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:46.260116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:46.265587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.266024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.266540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.266967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.267649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.268087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.268502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.273198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e74a9a06-3058-4cc2-aa9f-6698edf7fd31 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083576 Sep 01 08:20:46.273761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 583/1150] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:46 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:46.330964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.338458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9380d0de-4276-40e1-a8ec-8287eda44b2f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082804 Sep 01 08:20:46.339018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 568/1151] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:46 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:46.524915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:46.525443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:46.531919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.532389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.532813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.533486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.533924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.534369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.595493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.603180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-76c94626-2236-4842-aa56-a78177d80d67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082248 Sep 01 08:20:46.603733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 584/1152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:46 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:46.861932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:46.862585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:46.868608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.869094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.869520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.870205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:46.870670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:46.871082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:46.935881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.944429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.945859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:46.946990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f44b0b78-f4ca-4aa7-b541-7565c2312a6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088941 Sep 01 08:20:46.947541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 569/1153] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:46 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:47.067438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:47.068047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:47.073963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.075001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.075442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.076124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.076597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.077011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.099419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:47.100029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:47.107229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.107711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.108139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.108825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.109268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.109688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.140426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:47.148084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93e3c58f-6127-49fc-9056-cf19b84e4ad5 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084514 Sep 01 08:20:47.148644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 585/1154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:47 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:47.168902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:47.172348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:47.177387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c99ba7d1-9965-46e5-a2c2-cbe69809480a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081797 Sep 01 08:20:47.179118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 570/1155] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:47 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:47.294562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:47.295166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:47.300992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.301464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.301892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.302597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.303042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.303460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.359928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:47.360529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:47.363886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:47.366841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.367325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.367751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.368434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.368876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.369291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.371893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6a8ebc86-39b3-4a9e-805f-63c70defc2fd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081704 Sep 01 08:20:47.372451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 586/1156] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:47 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:47.431430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:47.439113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7c828aff-90d3-4628-8704-41f5baceead9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083579 Sep 01 08:20:47.439866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 571/1157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:47 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:47.625060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:47.625667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:47.631579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.632057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.632488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.633214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.633662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.634077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.693140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:47.701133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-79d939d0-1934-4917-bf43-a2a48194251b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.079986 Sep 01 08:20:47.701690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 587/1158] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:47 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:47.970916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:47.971475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:47.977495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.977972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.978434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:47.979135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:47.979582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:47.980000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.046733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.055032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.056466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.057578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-940bd359-f2c3-48d1-b2a3-41f947d99328 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090764 Sep 01 08:20:48.058145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 572/1159] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:47 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:20:48.168945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:48.169547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:48.175569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.176044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.176478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.177172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.177623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.178043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.200107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:48.200780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:48.206919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.207402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.207836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.208547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.208980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.209393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.239353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.247811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5838dda5-0f20-4313-a166-21b098e13ef9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082699 Sep 01 08:20:48.248389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 588/1160] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:48 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:48.272441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.280835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-542b0e8d-1973-4b31-8fd0-1094c686d10f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085039 Sep 01 08:20:48.281403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 573/1161] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:48 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:48.393429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:48.394018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:48.400416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.400887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.401312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.401992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.403123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.403574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.458445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:48.459147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:48.465359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.465836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.466280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.466977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.467425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.467843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.569103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.577645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f648e0e5-e763-49c8-99a7-ebb0d5b41cb4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.187932 Sep 01 08:20:48.578224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 589/1162] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:48 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:48.596273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.603823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a6f442fa-6b59-411d-94b8-8adb60f7a18d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.149205 Sep 01 08:20:48.604379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 574/1163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:48 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:48.721860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:48.722500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:48.728269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.728735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.729157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.729823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:48.730283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:48.730833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:48.791424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:48.803619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09726f0d-a1af-47d5-8b60-486efe2bd01e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085447 Sep 01 08:20:48.804187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 590/1164] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:48 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:49.081784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:49.082363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:49.088378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.088845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.089274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.090827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.091311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.091737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.153353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.161685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.163137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.164272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8423bf3-bd99-43b6-b140-68e8d75d631f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086539 Sep 01 08:20:49.164828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 575/1165] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:49 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:49.269115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:49.269755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:49.275763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.276249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.276694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.278072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.278876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.279343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.283611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:49.301143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:49.301750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:49.307652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.308163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.308609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.309310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.310059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.310177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.355203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.362816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f5f4ceb3-c566-4011-b9db-c0c3eb282e61 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.097516 Sep 01 08:20:49.363599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 591/1166] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:49 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:49.374109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.381739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-703392e0-b0a3-4f4c-a1de-924d5a926bfb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084508 Sep 01 08:20:49.382307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 576/1167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:49 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:49.599963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:49.600561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:49.608767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.609308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.609826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.610821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.611345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.611633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.623800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:49.624399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:49.630169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.630673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.631101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.631775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.632217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.632631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.675036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.682902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5e4dacca-8058-42dd-9e3c-5dda25fa4c06 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086683 Sep 01 08:20:49.684096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 592/1168] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:49 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:49.701132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.708911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93d9a76d-7e9c-43d2-89fb-1d32994b50e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089274 Sep 01 08:20:49.709430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 577/1169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:49 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:49.824333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:49.824931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:49.830858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.831330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.831754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.832428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:49.832869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:49.833275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:49.896903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:49.904960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c99029bb-8339-4541-abf0-3858280037ff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084669 Sep 01 08:20:49.905508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 593/1170] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:49 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:50.187690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:50.188243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:50.194378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.194863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.195378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.196096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.196436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.196857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.259238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:50.267601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:50.269022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:50.270129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c06ffc8-648f-4c63-a4cd-474cbd8bc7aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087175 Sep 01 08:20:50.270702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 578/1171] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:50 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:50.383606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:50.384240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:50.390251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.390767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.391204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.391914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.392367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.392791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.403096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:50.403708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:50.409763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.410253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.410813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.411524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.411970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.412385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.490091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:50.491963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:50.497888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-828b1334-d55d-4419-8966-8bbe4a96c2bf tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.118130 Sep 01 08:20:50.498491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 594/1172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:50 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:50.499636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a493a4ab-ec97-4a34-bd88-87706c02c9ca tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.100820 Sep 01 08:20:50.500191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 579/1173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:50 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:50.704094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:50.704697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:50.710922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.711406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.711815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.712486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.712930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.713342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.728968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:50.729623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:50.735986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.736472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.736910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.737605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.738053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.738510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.780968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:50.788668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b1d7a183-5fc6-48c9-9cbb-09df3ab11c4c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.088339 Sep 01 08:20:50.789237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 595/1174] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:50 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:50.917348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:50.925320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:50.925883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6043bc60-2703-4202-baa1-1f919ba3a2e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.200841 Sep 01 08:20:50.926013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:50.926459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 580/1175] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:50 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:50.931897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.932376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.932803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.933499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:50.934565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:50.934994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:50.993912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:51.002099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8491e091-c71c-474c-a233-d3c5e3e04260 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080618 Sep 01 08:20:51.002681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 596/1176] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:50 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:51.293815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:51.294436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:51.300391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.300867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.301292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.301976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.302447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.302864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.363189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:51.372207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:51.373635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:51.374780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4e0e3f8a-e17f-449b-998f-900435aea61d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085548 Sep 01 08:20:51.375328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 581/1177] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:51 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:51.518510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:51.519115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:51.524014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:51.525021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:51.525408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.525894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.526348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.527052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.527510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.527922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.532013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.532500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.532931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.533628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.534136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.534594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.599855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:51.608327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-930ebabc-2065-4362-83fb-9185a59c144d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093748 Sep 01 08:20:51.608898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 597/1178] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:51 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:51.618422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:51.626785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-142e23b6-92fd-4d81-bffa-8e978f7b0920 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.109566 Sep 01 08:20:51.627318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 582/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:51 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:51.810661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:51.811272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:51.817386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.817875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.818330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.819019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.819477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.819898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.880367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:51.887931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17467260-9ffd-4dfb-9b86-5ba2ec340554 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081494 Sep 01 08:20:51.888479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 598/1180] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:51 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:51.947498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:51.948097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:51.954784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.955264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.955698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:51.956392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:51.956839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:51.957262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.019444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.023187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:52.023866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:52.027271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0d28d73-d77e-46f5-9a94-5979c6b20079 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083512 Sep 01 08:20:52.027901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 583/1181] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:51 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:52.029903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.030418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.030865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.031525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.031970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.032383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.094998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.102496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca80bc04-594a-4fca-9d0b-d1303ab47c32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083054 Sep 01 08:20:52.103051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 599/1182] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:52 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:52.398596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:52.399220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:52.405138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.405610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.406037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.406743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.407188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.407602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.471215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.479466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.481431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.482568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-75905f78-ee6b-4264-8c34-ea3d0a8880f3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087802 Sep 01 08:20:52.483122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 584/1183] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:52 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:52.629463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:52.630065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:52.636143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.637314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.638036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.638957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.639460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.639897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.648110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:52.648728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:52.655026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.655506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.655938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.656632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.657076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.657491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.710507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.718392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd9df188-bc02-4ead-acd8-d4f4ce29300d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092701 Sep 01 08:20:52.718956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 600/1184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:52 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:52.729897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.738510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-64ab4aa1-fe1b-4633-a013-853b24bf65bb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.094524 Sep 01 08:20:52.739062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 585/1185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:52 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:52.908770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:52.909381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:52.915319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.915825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.916256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.916933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:52.917376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:52.918312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:52.978044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:52.986335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9256c991-8863-464b-b769-65fc0776ac6a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081291 Sep 01 08:20:52.986822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 601/1186] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:52 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:53.047406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:53.048001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:53.053885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.054395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.054826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.055510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.055950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.056364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.118645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:53.123823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:53.124459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:53.127210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad9e46ed-dfd4-47cf-bfc2-6e577ca8968f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084130 Sep 01 08:20:53.127777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 586/1187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:53 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:53.130435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.130917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.131352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.132048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.132500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.132923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.196224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:53.204005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b0c2e261-c917-4a8c-b1a8-e8ff3d51daa9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084972 Sep 01 08:20:53.204571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 602/1188] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:53 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:53.507775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:53.508385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:53.515077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.515563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.516001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.516693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.517144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.517566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.536888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:53.585091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:53.594696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:53.596235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:53.597437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b0521d4f-59ea-47bd-8bbe-766a1e1a4d8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.093502 Sep 01 08:20:53.598016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 587/1189] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:53 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:53.739224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:53.740053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:53.746666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.747156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.747597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.748292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.748734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.749149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.760323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:53.761100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:53.767420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.767908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.768345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.769046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:53.769495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:53.769925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:53.812763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:53.820564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1d3f275e-9694-494c-9ca8-625db7b99233 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085217 Sep 01 08:20:53.821196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 603/1190] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:53 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:53.838914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:53.847593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bec1edc9-9798-4759-978b-51a4e6a6efb5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.092080 Sep 01 08:20:53.848168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 588/1191] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:53 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:54.006723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:54.007336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:54.013768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.014356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.014871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.015587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.016082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.016452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.079524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.087102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6621ea7b-a6cb-47d4-aaff-1a77865e1a69 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084103 Sep 01 08:20:54.087695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 604/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:54 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:54.147327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:54.148071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:54.154749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.155229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.155651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.160829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.160829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.160829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.219375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.227711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:54.228081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-666260ca-1027-4756-9ded-5cb9bcb7c3ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084562 Sep 01 08:20:54.228323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:54.228820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 589/1193] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:54 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:54.235048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.235535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.235968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.236662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.237110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.237561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.297128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.304714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd102e8e-859c-444a-840b-cbc15dd457c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080913 Sep 01 08:20:54.305267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 605/1194] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:54 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:54.621674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:54.622240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:54.628212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.628684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.629112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.629797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.630244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.630681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.691546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.700095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.701530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.702677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-44464755-f206-4b31-a767-1b932ae7289b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085579 Sep 01 08:20:54.703238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 590/1195] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:54 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:54.841749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:54.842383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:54.848410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.848915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.849348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.850046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.850547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.850999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.868525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:54.869127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:54.875703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.876105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.876553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.877210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:54.877652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:54.878061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:54.918001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.926287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-753f7a1d-cc5e-4172-981c-3df635767589 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089031 Sep 01 08:20:54.926999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 606/1196] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:54 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:54.944841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:54.954563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ecc6f6db-71f6-4cd4-90c5-33751c58224d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089658 Sep 01 08:20:54.955153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 591/1197] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:54 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:55.113261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:55.113876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:55.120195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.120674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.121612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.122340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.122768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.123187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.184101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:55.187624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:55.192827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f57d3c61-c37c-4db1-aaec-314e4dfd7545 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086756 Sep 01 08:20:55.193390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 607/1198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:55 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:55.249707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:55.250360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:55.256313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.256778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.257198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.257877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.258335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.258755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.320531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:55.325495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:55.326092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:55.328850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fba1536a-3ee6-4a44-8ca6-937559761ca6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083634 Sep 01 08:20:55.329678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 592/1199] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:55 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:55.332515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.332994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.333427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.334114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.334595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.335014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.395802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:55.404333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ffed3c7b-24f5-4325-b7b0-9a8ee6f51334 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082748 Sep 01 08:20:55.405144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 608/1200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:55 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:55.726307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:55.726866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:55.734474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.734972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.735408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.736162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.736614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.737107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.801875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:55.810925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:55.812363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:55.813460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c15ae349-5d53-4462-9cee-5919d5d51118 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091236 Sep 01 08:20:55.814059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 593/1201] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:55 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:55.948224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:55.948843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:55.955726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.956206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.956633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.957318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.957758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.958176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.975808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:55.976480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:55.982590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.983074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.983508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:55.984202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:55.985305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:55.985305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.023677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.032243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6dedaa4d-cdde-4e4c-a580-0efea154736b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087858 Sep 01 08:20:56.032816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 609/1202] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:55 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:56.049713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.057259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b8288eb4-a854-48ef-9212-06da8cfdf2d7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085211 Sep 01 08:20:56.057814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 594/1203] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:55 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:56.212863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:56.213465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:56.219633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.220104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.220527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.221203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.221647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.222057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.282482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.289852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c50df759-a3c7-4646-adbd-de53b6421414 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080798 Sep 01 08:20:56.290426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 610/1204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:56 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:56.350736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:56.351377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:56.357970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.358548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.358867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.359546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.359984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.360393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.425020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:56.425618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:56.431651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.432231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.432550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.433234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.434345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.434795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.435593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.444739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8c9bf03d-a434-417b-8dbe-807eb7e108ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097742 Sep 01 08:20:56.445311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 595/1205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:56 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:56.497140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.505040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-369345ab-7eb0-4ad1-9e44-6dd1854bb941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083876 Sep 01 08:20:56.505593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 611/1206] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:56 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:56.837493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:56.838127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:56.846499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.847328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.847817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.848519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:56.848975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:56.849397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:56.910733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.919638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.921061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:56.922162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1537438-c853-4d9f-9dda-390ced13b627 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088577 Sep 01 08:20:56.922749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 596/1207] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:56 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:20:57.052886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:57.053508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:57.060074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.060547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.060972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.061653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.062097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.062536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.078387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:57.079027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:57.084927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.085445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.085878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.086765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.087214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.087685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.126195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:57.134154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-572c74be-728e-4d71-816f-b679f2fe6efe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085023 Sep 01 08:20:57.134756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 612/1208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:57 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:57.155261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:57.162926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9a0474fa-ac50-483b-9659-2ac4ec58cc1f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089078 Sep 01 08:20:57.163488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 597/1209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:57 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:57.310891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:57.311495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:57.317336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.317805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.318242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.318927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.319373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.319788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.380292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:57.388841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03494571-7477-42d7-b118-262af26d9033 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081870 Sep 01 08:20:57.389407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 613/1210] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:57 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:57.467309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:57.467940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:57.474049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.474563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.474992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.475683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.476125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.476548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.526486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:57.527148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:57.533478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.533964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.534434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.535170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.535618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.536038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.543918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:57.552280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b84d84f-cfb9-4ef6-87d5-5b3d0e2f25c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088934 Sep 01 08:20:57.553061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 598/1211] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:57 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:57.600701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:57.608945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95559774-4b05-402a-a4b7-2f8721caab4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086323 Sep 01 08:20:57.609511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 614/1212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:57 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:57.946525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:57.947241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:57.953844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.954358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.954788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:57.955484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:57.955927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:57.956346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.023432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.034961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.036415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.037537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-20835633-6644-4e00-b009-d1453d6b83b2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095798 Sep 01 08:20:58.038322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 599/1213] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:57 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:58.154669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:58.155280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:58.161541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.162020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.162490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.163183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.163633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.164050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.183821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:58.184536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:58.190459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.190948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.191369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.192056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.192547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.192963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.226836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.235345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3124fcb6-5751-483f-8bd1-00d0223f6a3e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085180 Sep 01 08:20:58.235913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 615/1214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:58 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:58.256258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.264172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5c827fbb-8230-4137-b8de-c5048814fab4 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084099 Sep 01 08:20:58.264727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 600/1215] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:58 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:20:58.409203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:58.409806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:58.415834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.416319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.416750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.417433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.418561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.418921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.478297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.486509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed554164-14fd-44cb-ab85-cd4803189578 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081150 Sep 01 08:20:58.487054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 616/1216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:58 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:58.575160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:58.575766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:58.581906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.582426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.582863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.583552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.584003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.584418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.630972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:58.631586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:58.637582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.638062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.638520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.639215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:58.639664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:58.640087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:58.647424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.655682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a9c9456c-b57c-45e5-8db4-6b886f1d7c84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084358 Sep 01 08:20:58.656255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 601/1217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:58 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:58.712621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:58.721045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b4505a1c-3c9b-4173-a786-c0d14b8063e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.093907 Sep 01 08:20:58.723615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 617/1218] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:58 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:59.060967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:59.061568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:59.067670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.068144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.068599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.069275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.069716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.070165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.132699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.141237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.142697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.143801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc259b4b-b228-4654-bea6-c7af48c6d7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086800 Sep 01 08:20:59.144363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 602/1219] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:20:59 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:20:59.255900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:59.256513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:59.262574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.263059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.263496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.264193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.264646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.265071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.284816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:59.285415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:59.291263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.291740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.292161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.293452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.293896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.294349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.325939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.333872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fb936288-df9e-4eef-a174-f1f193bde4e0 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.081801 Sep 01 08:20:59.334579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 618/1220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:59 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:59.357465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.365054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e14d9330-b218-4c41-bd11-74f07998b092 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084369 Sep 01 08:20:59.365597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 603/1221] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:59 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:59.507794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:59.508394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:59.514573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.515046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.515472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.516174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.516618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.517034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.578103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.586037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f56534c-8756-4229-891e-384a5c855ebc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082008 Sep 01 08:20:59.586643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 619/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:59 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:59.677727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:59.678349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:59.684836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.685300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.685721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.686418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.686859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.687272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.691139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:59.742084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:20:59.742838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:20:59.747787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.749048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.749523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.749948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.750657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:20:59.751101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:20:59.751511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:20:59.755550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-86a0c110-2bdf-43f8-904f-9dae03101a44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081640 Sep 01 08:20:59.756113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 604/1223] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:59 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:20:59.817338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:20:59.825149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cccc6425-ff87-4c60-93d4-2c60f615ea53 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086820 Sep 01 08:20:59.825781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 620/1224] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:20:59 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:00.166536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:00.167091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:00.173711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.174251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.174710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.175395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.175841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.176258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.240705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.250832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.252271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.253368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-55926fef-ffa6-4789-8692-d74feb6d0590 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090817 Sep 01 08:21:00.253919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 605/1225] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:00 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:00.359714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:00.360316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:00.366408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.366898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.367328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.368018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.368465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.368884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.385828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:00.387259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:00.393275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.393759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.394192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.394989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.395437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.395861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.432338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.441143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9d6966d1-2877-4592-a28a-8397949ed2d7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085212 Sep 01 08:21:00.443879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 621/1226] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:00 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:00.458436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.466485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6529f1f8-dd7b-4b8c-b9d3-20e7fd234ff0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084563 Sep 01 08:21:00.467047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 606/1227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:00 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:00.608211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:00.608824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:00.614751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.615225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.615648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.616328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.616766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.617184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.677730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.686281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-283a0afc-434f-4699-b86b-fff7461fd4da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082436 Sep 01 08:21:00.686862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 622/1228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:00 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:00.776516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:00.777115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:00.783392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.783867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.784299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.784981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.785424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.785870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.848099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.848292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:00.848722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:00.855143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.855621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.856045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.856559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dda65f01-e693-4fec-aa49-9e9c643f6c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083694 Sep 01 08:21:00.857416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:00.857668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 607/1229] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:00 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:00.857860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:00.858295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:00.921068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:00.929105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-da85b54d-3d9c-4bf3-831f-6e06e5d68a67 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087715 Sep 01 08:21:00.929672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 623/1230] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:00 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:01.276293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:01.276908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:01.283129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.283608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.284039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.284720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.285168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.285590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.347426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:01.355791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:01.357259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:01.358388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2faed80b-17f6-46d6-8b6b-4375b2997ba3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085927 Sep 01 08:21:01.358943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 608/1231] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:01 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:01.463710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:01.464608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:01.471463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.472331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.472444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.473038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.473480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.473896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.487456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:01.488061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:01.494235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.494760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.495187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.495878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.496326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.496744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.497179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:01.548935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:01.556699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-100d8b2c-982e-46bd-9557-f60bcfb8d8f2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.096825 Sep 01 08:21:01.557265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 624/1232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:01 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:01.568256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:01.576108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-71fa6384-c433-489d-87cb-98f47c03ab25 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.092412 Sep 01 08:21:01.576664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 609/1233] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:01 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:01.707107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:01.707706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:01.713556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.714032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.714752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.715430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.715883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.716395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.778208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:01.785774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40601b5d-524e-4d9e-b0a7-5f380ff75326 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082458 Sep 01 08:21:01.786344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 625/1234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:01 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:01.878484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:01.879008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:01.884872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.885344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.885776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.886492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.886937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.887351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.946377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:01.950885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:01.951502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:01.954577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be51e972-e16b-446b-9e34-59e7ec573cdf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.079914 Sep 01 08:21:01.955150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 610/1235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:01 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:01.957385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.957862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.958317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:01.959040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:01.959491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:01.959906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.025303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:02.033705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6e63be0d-8510-4631-9395-8979d80c1175 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086656 Sep 01 08:21:02.034315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 626/1236] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:01 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:02.381029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:02.381642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:02.387692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.388812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.389239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.389928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.390401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.390814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.455778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:02.464961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:02.467028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:02.468159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c28debf8-44e3-4b6a-8478-c19e7832d26f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090961 Sep 01 08:21:02.468728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 611/1237] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:02 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:02.578623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:02.579422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:02.585413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.585894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.586361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.587087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.587542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.587961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.598291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:02.598901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:02.604993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.605506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.605943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.606670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.607116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.607697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.673165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:02.680717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d0ca6215-a199-43c1-a2a7-6b74c6e7ed8a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.106583 Sep 01 08:21:02.681271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 627/1238] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:02 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:02.688930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:02.696382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f4ff98d-de4c-4416-911d-aed7928ff8a3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.102516 Sep 01 08:21:02.696959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 612/1239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:02 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:02.806590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:02.807195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:02.808993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:02.815296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.815776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.816205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.816893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.817347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.817763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.881187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:02.889266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eaa32b14-8a1a-4ed5-b743-4e9472a140cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086433 Sep 01 08:21:02.889838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 628/1240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:02 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:02.974785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:02.975386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:02.981390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.982480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.982915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:02.983603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:02.984053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:02.984470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.044807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.053036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-44a100b9-e9eb-4ead-9795-a8f10eb510e7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082048 Sep 01 08:21:03.053592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 613/1241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:02 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:03.055491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:03.056092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:03.062612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.063083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.063506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.064186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.064625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.065038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.125974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.133738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8576af5b-05d4-49d4-9403-a0cbd41797e5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081908 Sep 01 08:21:03.134332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 629/1242] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:03 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:03.490891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:03.491801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:03.493278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:03.498828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.499302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.499727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.500414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.500854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.501261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.567110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.575579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.577602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.578764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9965f773-6a27-402e-8934-612adf4b7ae8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091735 Sep 01 08:21:03.579318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 614/1243] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:03 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:03.701116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:03.702538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:03.708678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.709160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.709591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.710338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.710784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.711201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.717334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:03.718139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:03.724377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.724793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.725226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.725917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.727084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.727508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.773514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.781527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8534bd03-273b-4d8c-8340-1480ae643235 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084388 Sep 01 08:21:03.782086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 630/1244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:03 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:03.799293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.806727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2e493aba-393a-4f1c-802d-4f4995d4b3b9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.093528 Sep 01 08:21:03.807277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 615/1245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:03 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:03.910132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:03.910769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:03.916860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.917331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.917758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.918474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:03.918918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:03.919331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:03.978342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:03.986338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0010e389-ea48-48f7-bc4f-02bb27be3069 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080033 Sep 01 08:21:03.986875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 631/1246] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:03 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:04.073939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:04.074729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:04.082489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.082966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.083393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.084154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.084519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.084946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.148000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:04.155356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:04.155959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:04.156222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f3da450a-10e6-4f75-9b00-152d2c27b0ed tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086084 Sep 01 08:21:04.156792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 616/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:04 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:04.161773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.162245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.162713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.163413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.163853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.164266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.226527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:04.234798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d84efa9-11f5-408c-9495-2171e5bb27bd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083648 Sep 01 08:21:04.235371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 632/1248] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:04 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:04.601149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:04.601748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:04.608139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.608609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.609032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.609700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.610146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.610584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.672004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:04.680333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:04.681756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:04.682874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c77bbad6-3a7a-432d-be84-53848865f659 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085739 Sep 01 08:21:04.683428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 617/1249] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:04 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:04.801862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:04.802614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:04.808595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.809061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.809487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.810165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.810795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.811213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.876578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:04.884318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-88d94328-50bc-4905-8603-beafbdc02b72 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086332 Sep 01 08:21:04.884883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 633/1250] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:04 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:04.931475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:04.932082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:04.938735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.939217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.939700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:04.940384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:04.940829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:04.941248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.005196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:05.007486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:05.008132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:05.012842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-71db2c1d-13ad-4730-8a25-64cd609df129 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.189039 Sep 01 08:21:05.013401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 618/1251] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:04 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:05.014788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.015273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.015705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.016397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.016847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.017298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.076047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:05.084140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-417c981b-2410-43f4-97a6-6717760f62c6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080403 Sep 01 08:21:05.084691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 634/1252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:05 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:05.177386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:05.177895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:05.183729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.184195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.184619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.185287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.185757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.186175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.246008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:05.253747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e666b640-09a4-4c02-a0b1-fdbfac43bdee tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080273 Sep 01 08:21:05.254330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 619/1253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:05 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:05.255600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:05.256207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:05.261998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.262494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.262921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.264100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.264604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.265020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.324100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:05.332320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fdad23f9-236e-4e43-ab4a-d327c1d71c38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080614 Sep 01 08:21:05.332885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 635/1254] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:05 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:05.705860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:05.706491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:05.712568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.713045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.713471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.714453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:05.714897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:05.715311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:05.781538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:05.785169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:05.792967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:05.794414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:05.796176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-df3008b8-2ba4-46bc-aaec-11b197c09df6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.093661 Sep 01 08:21:05.796950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 620/1255] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:05 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:06.006920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:06.007529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:06.013428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.013902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.014908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.015583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.016025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.016442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.033538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:06.034137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:06.040213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.040746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.041198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.041907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.042376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.042785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.078693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.086404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3b29b374-c867-4017-b3c3-792853274d06 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.184813 Sep 01 08:21:06.087209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 636/1256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:05 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:06.105032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:06.105795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:06.111570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.112989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.113759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.114170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.114913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.115291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.115763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.119751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-05a0060a-0601-433b-beb0-d1f0f1178de2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090703 Sep 01 08:21:06.120325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 621/1257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:06 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:06.178051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.185559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c67a385c-56da-49ee-9fae-f9202e2780a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084359 Sep 01 08:21:06.186845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 637/1258] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:06 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:06.273720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:06.274352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:06.280180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.280648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.281072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.281745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.282188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.282707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.342754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.350460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-95b39e45-474c-4eae-92de-2dc5f501d1fb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080526 Sep 01 08:21:06.351023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 622/1259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:06 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:06.354043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:06.354692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:06.361468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.362033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.362571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.363361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.363898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.364385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.535455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.543283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-adcbd5c8-18f6-497a-9b9f-ffdfb45b0bf1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.193258 Sep 01 08:21:06.543848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 638/1260] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:06 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:06.819714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:06.820350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:06.826202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.826735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.827238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.827913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:06.828351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:06.828764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:06.895247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.903506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.905555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:06.906688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5c91990c-61e8-4dd8-a321-831f8aa3eae2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090859 Sep 01 08:21:06.907241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 623/1261] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:06 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:07.107961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:07.108505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:07.114335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.114818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.115248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.115925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.116371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.116789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.142068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:07.142695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:07.148674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.149152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.149576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.150280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.150719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.151130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.177030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:07.184544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-86c976d9-cd64-41a1-945e-384d933a4e31 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080482 Sep 01 08:21:07.185102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 639/1262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:07 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:07.206743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:07.207343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:07.211500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:07.213612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.214527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.214964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.215653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.216096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.216509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.220211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9016501-1c92-4a1e-9fbd-05506ac9424d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082582 Sep 01 08:21:07.220771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 624/1263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:07 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:07.279063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:07.287069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dcee7691-071b-461f-84f9-6d3f86519adf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084189 Sep 01 08:21:07.287619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 640/1264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:07 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:07.371809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:07.372370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:07.378201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.378719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.379151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.379838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.380295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.380717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.443194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:07.451444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1509820c-596b-45f7-854c-27fff2d54c3d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083510 Sep 01 08:21:07.452617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 625/1265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:07 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:07.564833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:07.565450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:07.571623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.572113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.572550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.573259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.573710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.574129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.579282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:07.637382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:07.645739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e330de7e-eba6-48e1-be4b-126e0ac2a3c4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084902 Sep 01 08:21:07.646322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 641/1266] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:07 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:07.928013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:07.928557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:07.934522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.935029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.935454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:07.936132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:07.937213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:07.937633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.001403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.010494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.011972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.013138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ae455989-db8f-4f4f-936a-c7ab1a794288 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089106 Sep 01 08:21:08.013702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 626/1267] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:07 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:08.205353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:08.205892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:08.211780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.212257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.212685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.213366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.213812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.214517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.240931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:08.241544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:08.247523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.247997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.248431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.249313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.249784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.250205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.278594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.286924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-51384cb5-ac64-4028-9ab0-e64d7c4c2ba6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086178 Sep 01 08:21:08.287493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 642/1268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:08 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:08.307977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:08.308680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:08.311963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.314611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.315087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.315512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.316194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.316634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.317044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.319760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9ca4517e-8292-47bf-b3b6-4c280bb6dd10 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082576 Sep 01 08:21:08.320315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 627/1269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:08 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:08.376405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.383882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8afb8613-2175-4f04-84c4-d88189443da2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079671 Sep 01 08:21:08.384672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 643/1270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:08 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:08.473428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:08.474035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:08.479962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.480436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.480866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.481536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.481979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.482428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.543118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.552588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1942ec49-21b0-49b9-87cd-d8c875134d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082804 Sep 01 08:21:08.553145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 628/1271] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:08 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:08.667555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:08.668166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:08.674368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.674851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.675284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.675979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:08.676433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:08.676865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:08.744764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:08.753882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6af29be9-bb5a-4ad7-a425-8a81d427c252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090087 Sep 01 08:21:08.754498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 644/1272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:08 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:09.037034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:09.037642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:09.043583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.044061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.044496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.045176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.046247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.046717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.109267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.117903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.119365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.120477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-379096f5-db0e-4986-a011-391a830cabcc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087365 Sep 01 08:21:09.121030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 629/1273] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:09 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:09.307702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:09.308263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:09.314127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.314636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.315060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.315761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.316204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.316623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.341128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:09.341760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:09.348376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.348853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.349283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.349962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.350456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.350860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.377086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.384664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca91df92-d9b4-48e2-8189-855946cbda08 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.080835 Sep 01 08:21:09.385228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 645/1274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:09 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:09.404813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:09.405422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:09.410995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.411417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.411902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.412339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.413048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.413477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.413900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.418640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e53f69c0-1011-49ae-b67f-0c714330db88 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081567 Sep 01 08:21:09.419209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 630/1275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:09 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:09.476164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.484225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c1e759e3-75c4-4f78-bd47-0c2816f5a75f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082911 Sep 01 08:21:09.484779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 646/1276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:09 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:09.573811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:09.574359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:09.580877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.581352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.581775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.582489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.582931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.583344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.643728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.651185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-49599572-fc12-4069-b586-f8ac4b8f62a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081361 Sep 01 08:21:09.651765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 631/1277] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:09 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:09.775015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:09.775645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:09.781839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.782342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.782782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.783470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:09.783917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:09.784333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:09.846860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:09.854597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5e4262a-43de-47c0-b37a-2bb0dfa3364d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083408 Sep 01 08:21:09.855188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 647/1278] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:09 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:10.143618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:10.144161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:10.150171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.150682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.151110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.151822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.152265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.152678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.213723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.223155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.224582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.225684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a24acc52-acb6-4f00-aec8-adf59682c7ed tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086078 Sep 01 08:21:10.226234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 632/1279] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:10 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:10.405697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:10.406282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:10.412114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.412585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.413011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.413687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.414125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.414581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.439813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:10.440453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:10.446503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.447084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.447523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.448205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.448646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.449060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.478711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.486976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5f7fa590-15d3-45b4-8364-d0f6f9926f69 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085259 Sep 01 08:21:10.487542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 648/1280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:10 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:10.505085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:10.505772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:10.511536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.511871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.512488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.512925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.513612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.514149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.514574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.519157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4ba58c1c-952c-47d0-a956-a8d9a238b538 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083692 Sep 01 08:21:10.520066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 633/1281] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:10 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:10.574936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.582579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f44a6596-83f4-44ae-9060-0037f7e8ae74 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081252 Sep 01 08:21:10.583147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 649/1282] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:10 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:10.672183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:10.672705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:10.678533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.678997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.679420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.680089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.680533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.680938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.739805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.747300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9bc7ff28-0584-4e02-ad39-71ebb3e4a8ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.079583 Sep 01 08:21:10.747864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 634/1283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:10 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:10.877599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:10.878844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:10.884071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.884547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.884970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.885651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:10.886204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:10.886683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:10.951663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:10.960078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47af4b00-cfcd-40dc-a01d-47899a5332b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088217 Sep 01 08:21:10.960625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 650/1284] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:10 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:11.249535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:11.250317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:11.256146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.256616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.257037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.257707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.258148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.258595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.324422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:11.333287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:11.334734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:11.335831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f310e78-73a5-4ca8-b876-9347a0fe2dc8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090933 Sep 01 08:21:11.336375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 635/1285] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:11 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:11.508804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:11.509289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:11.515921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.516389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.516814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.517493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.517934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.518380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.539900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:11.540503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:11.546666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.547138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.547566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.548258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.548701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.549111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.582175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:11.590103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe5ae395-2392-4b2d-9581-49fbad48cd3c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085322 Sep 01 08:21:11.590691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 651/1286] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:11 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:11.603447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:11.604192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:11.610304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.610794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.611226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.611556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:11.611925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.612378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.612800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.619190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9290f86-48fb-4e17-a4d8-278bb2bc9c97 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083105 Sep 01 08:21:11.619754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 636/1287] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:11 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:11.676977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:11.684473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca0ff1c3-873b-4c50-883e-c4087c3389ae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084973 Sep 01 08:21:11.685030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 652/1288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:11 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:11.769277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:11.769862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:11.777754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.778238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.778720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.779416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.779864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.780283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.798965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:11.841055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:11.849266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9d0c4473-4648-4d92-ae72-fb8750271b17 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084520 Sep 01 08:21:11.849833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 637/1289] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:11 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:11.981010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:11.981618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:11.987746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.988219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.988647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:11.989333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:11.989783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:11.990196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.052286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:12.062643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-01b5ea22-3771-43bd-80f0-788fe7189786 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084916 Sep 01 08:21:12.063217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 653/1290] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:11 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:12.360053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:12.360581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:12.366912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.367386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.367814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.368495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.368939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.369357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.433896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:12.444223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:12.445636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:12.446782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec97b1e2-f04e-465a-bcc3-80028055327c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091315 Sep 01 08:21:12.447326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 638/1291] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:12 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:12.611376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:12.611941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:12.617691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.618163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.618618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.619288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.619729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.620150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.639212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:12.639884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:12.645716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.646352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.646779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.647454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.647891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.648298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.684208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:12.692880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4838a56d-8d69-48ef-a778-2aee3f5af2a6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.085784 Sep 01 08:21:12.693444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 654/1292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:12 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:12.704598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:12.705201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:12.710328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:12.711518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.711996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.712430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.713116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.713561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.714246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.718562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62f0f120-ef1a-4c29-ac42-44586df2f32b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082632 Sep 01 08:21:12.719127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 639/1293] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:12 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:12.774868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:12.782384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a49ffedc-7c41-42c8-bdc4-e13ab945bec4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081668 Sep 01 08:21:12.782941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 655/1294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:12 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:12.967794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:12.968557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:12.974568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.975035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.975454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:12.976132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:12.976567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:12.976975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.037143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.045099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3a72000-530e-487a-b654-d2fa1bed5e67 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.178920 Sep 01 08:21:13.045664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 640/1295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:12 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:13.084104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:13.084710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:13.086984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:21:13.087147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 (ip 10.222.0.43) !!! Sep 01 08:21:13.093255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.093744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.094178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.094902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.095347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.095766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.158761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.166368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-84851e76-4ff6-4511-8b5f-95f1d0745abd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086125 Sep 01 08:21:13.166933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 656/1296] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:13 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:13.471173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:13.471711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:13.477935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.478444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.478870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.479545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.479987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.480429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.544234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.553435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.554912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.556009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ba001c54-0385-4080-93e0-26b245232b99 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088996 Sep 01 08:21:13.556564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 641/1297] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:13 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:13.713380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:13.714337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:13.721551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.721959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.722426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.723116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.723557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.723971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.739612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:13.740266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:13.746809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.747523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.748065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.748749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.749280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.749764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.784291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.787705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:13.792969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5ceed5c-8626-4090-8860-c70ab70c93af tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083372 Sep 01 08:21:13.793542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 657/1298] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:13 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:13.811093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:13.811789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:13.812112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.817896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.818398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.818823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.819441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5632aaf2-332f-442a-9e8f-ec8ab2bf30b3 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084365 Sep 01 08:21:13.819542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:13.819932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:13.820036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 642/1299] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:13 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:13.820424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:13.880569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:13.888245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9323dac1-0968-4064-bb2c-12dcbf9eadad tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080984 Sep 01 08:21:13.888798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 658/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:13 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:14.065664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:14.066297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:14.072152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.072631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.073059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.073736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.074181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.074624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.137572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.145909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3442f7fd-d594-431a-b042-2f35c83c2a81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084661 Sep 01 08:21:14.146513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 643/1301] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:14 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:14.187972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:14.188582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:14.199687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.200174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.200609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.201308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.201790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.202288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.264226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.273570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-43f7d2db-bf3c-49ae-910f-d32b42be62f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089820 Sep 01 08:21:14.274141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 659/1302] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:14 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:14.690049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:14.691178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:14.701731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.702637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.703428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.704673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.705476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.706279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.772060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.780368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.781922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.783045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3d16669a-d893-457b-a54d-7055b15bfe57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.207699 Sep 01 08:21:14.783599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 644/1303] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:14 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:14.813460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:14.814052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:14.819922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.820391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.820817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.821489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.821931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.822371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.840797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:14.841412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:14.847280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.847763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.848209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.848878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.849326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.849747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.883315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.892117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6b845b86-4d9b-4418-abcc-0049c2a8b2db tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082883 Sep 01 08:21:14.892965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 660/1304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:14 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:14.909171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:14.909783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:14.915904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.916217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.916642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.917321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:14.917769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:14.918176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.918329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:14.926278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b4ff3d6-18c3-4933-b314-ae5034b781fe tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089490 Sep 01 08:21:14.926854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 645/1305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:14 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:14.979119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:14.987300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2adae930-3c17-4cb2-87b4-6e50cb779541 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082049 Sep 01 08:21:14.987861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 661/1306] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:14 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:15.168092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:15.168697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:15.175325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.175795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.176224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.176897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.177348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.177764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.237852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:15.245456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b54eff55-c716-4d9b-ac12-b72f3f342767 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081199 Sep 01 08:21:15.246032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 646/1307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:15 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:15.297057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:15.297681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:15.303902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.304381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.304819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.305521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.305971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.306417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.370013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:15.381064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5e82c2bc-a36b-4880-aadd-229f4eb55d81 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089162 Sep 01 08:21:15.381644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 662/1308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:15 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:15.805370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:15.806007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:15.812910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.813379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.813804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.814522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.814961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.815370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.880095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:15.888207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:15.889631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:15.891299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-75250135-faee-4b68-8d44-cfd0ae02bc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089967 Sep 01 08:21:15.891849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 647/1309] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:15 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:15.915501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:15.916095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:15.922223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.922728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.923155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.923833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.924283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.924689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.947682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:15.948286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:15.954872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.955426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.955853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.956543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:15.956991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:15.957416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:15.985280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:15.996194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-344ba7fe-9c95-48e3-9e4b-ac0540e735c8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084362 Sep 01 08:21:15.997045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 663/1310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:15 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:16.009245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:16.009881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:16.017070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.017562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.017998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.018743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.019192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.019616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.020566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:16.033900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bfc290cc-8042-4a47-bd91-e417560c149c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.089960 Sep 01 08:21:16.046282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 648/1311] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:15 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:16.080721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:16.088336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16c9975e-4912-47dd-b4d8-d4a3665b0e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082932 Sep 01 08:21:16.089162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 664/1312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:16 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:16.267170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:16.267804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:16.273704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.274177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.274645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.275326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.275776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.276189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.339524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:16.347446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3763407-fbf2-4e36-b92c-733dadedd0cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084859 Sep 01 08:21:16.348002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 649/1313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:16 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:16.402403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:16.403034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:16.409109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.409587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.410015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.410728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.411170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.411582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.475607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:16.483401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc4b6f9d-f497-4896-9f23-8ebe5a0bbf49 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084736 Sep 01 08:21:16.484945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 665/1314] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:16 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:16.914696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:16.915308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:16.921656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.922139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.922602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.923309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:16.923765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:16.924188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:16.986124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:16.994163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:16.995605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:16.996852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1dd5fc92-7502-4bfb-b51d-f4e071f7ba38 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086240 Sep 01 08:21:16.997397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 650/1315] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:16 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:17.017423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:17.018027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:17.023882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.024354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.024776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.025457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.025901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.026340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.054503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:17.055139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:17.061020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.061493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.062485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.063141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.063585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.064002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.087752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:17.095911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-320febbc-9555-43b3-bbcb-7db0e6f1a1a2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082846 Sep 01 08:21:17.096389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 666/1316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:17 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:17.109407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:17.110003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:17.115878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.116361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.116780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.117457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.117897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.118328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.126948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:17.134525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8267049e-c73f-4b6c-b20d-3de95b99233e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083736 Sep 01 08:21:17.135094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 651/1317] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:17 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:17.178336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:17.185726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c095ed8-4320-496e-aff9-403ee6bbbd30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080193 Sep 01 08:21:17.186293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 667/1318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:17 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:17.368056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:17.368664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:17.375710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.376186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.376614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.377296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.377737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.378151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.436539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:17.444956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f2cf045-58c9-4ce4-96c4-0d896e82a78f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080718 Sep 01 08:21:17.445515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 652/1319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:17 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:17.506563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:17.507276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:17.513171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.513649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.514084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.514804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:17.515255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:17.515681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:17.581747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:17.589907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1acab95e-bba6-4c43-aaae-83e95423da58 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087132 Sep 01 08:21:17.590507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 668/1320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:17 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:18.020726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:18.021349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:18.027409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.027889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.028331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.029028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.029475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.029900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.096989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.104962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.106409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.107484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-94e44e51-8fc5-4271-9386-193f6add6d21 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090801 Sep 01 08:21:18.108045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 653/1321] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:18 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:18.116488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:18.117205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:18.123102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.123571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.123994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.125268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.125881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.126321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.156506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:18.157254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:18.163189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.163663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.164088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.164777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.165218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.165633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.169691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:18.186410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.194880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41ab7771-1361-4f50-9938-0c83220933ae tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082117 Sep 01 08:21:18.195451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 669/1322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:18 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:18.206564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:18.207444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:18.213115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.214604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.215179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.215910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.216367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.216798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.229635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.237634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e8efdc7-a57c-4446-ba5f-6d2774fc4221 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085208 Sep 01 08:21:18.238181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 654/1323] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:18 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:18.278492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.286274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17d0969f-6305-42fe-8f91-dcc3d2e4b861 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083329 Sep 01 08:21:18.286828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 670/1324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:18 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:18.465219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:18.465830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:18.472814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.473013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.473445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.474134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.474607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.475026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.536805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.544540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-588e1f84-0d63-4ec9-bc19-97659735757a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083396 Sep 01 08:21:18.545090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 655/1325] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:18 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:18.611016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:18.611623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:18.617611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.618085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.618540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.619221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:18.619666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:18.620086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:18.681789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:18.690587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a14ebbba-1413-4947-8eef-5e4e268b314a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083211 Sep 01 08:21:18.691169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 671/1326] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:18 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:19.131254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:19.131864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:19.137975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.138518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.138956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.139653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.140925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.141582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.202921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.210922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.212351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.213446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d616b0a-fe30-4c09-89e3-d606eca12417 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086166 Sep 01 08:21:19.214284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 656/1327] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:19 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:19.215797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:19.216527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:19.223088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.223564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.223992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.224672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.225110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.225545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.258552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:19.259278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:19.265292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.265772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.266201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.266918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.267365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.267809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.286562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.293905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-abeede70-3da1-4621-9457-8f23c3de30f3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082319 Sep 01 08:21:19.294483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 672/1328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:19 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:19.306772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:19.307471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:19.313341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.313810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.314236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.314938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.315381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.315793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.330907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.338891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-77e26a28-fa11-470e-8963-1ce2269a86a0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083893 Sep 01 08:21:19.339460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 657/1329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:19 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:19.376104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.383812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfe1def1-eac5-4f32-94fd-11918b4b6af5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080624 Sep 01 08:21:19.384278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 673/1330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:19 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:19.565927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:19.566551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:19.572495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.572971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.573395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.574084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.574561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.574976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.636880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.644844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-164ae1b0-1b57-41f8-819d-47ff72795e53 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083390 Sep 01 08:21:19.645393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 658/1331] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:19 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:19.716281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:19.716934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:19.723637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.724181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.724625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.725324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:19.725776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:19.726198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:19.747637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:19.792519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:19.800914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d54b5585-4b76-4b6a-b8dd-4ba3ff6f82b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088798 Sep 01 08:21:19.801485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 674/1332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:19 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:20.238024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:20.238663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:20.246502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.246989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.247417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.248112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.248553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.249039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.314673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:20.315264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:20.326122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.328337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.328820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.329255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.330538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.330538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.330854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.335909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.337354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.338494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4f009402-e072-4f36-acba-55a210d7add1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.105323 Sep 01 08:21:20.339310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 659/1333] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:20 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:20.362323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:20.363233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:20.369430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.369990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.370438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.371133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.371571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.371975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.399283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.408242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-87a16036-0bfd-41c2-861e-3d8d51a87551 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.097308 Sep 01 08:21:20.408816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 675/1334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:20 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:20.413796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:20.414438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:20.424661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.425147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.425576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.426355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.426816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.427242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.438605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.448957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d2917316-b5f9-471f-a669-3956a2367bae tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.091688 Sep 01 08:21:20.449533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 660/1335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:20 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:20.496384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.503991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-27400e77-8e5d-44d5-b06c-67d037c314f7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.093862 Sep 01 08:21:20.504546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 676/1336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:20 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:20.665618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:20.666208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:20.672231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.672704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.673132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.673806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.674247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.674688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.736587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.744243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-40eb1c42-be83-4b3e-abcf-4aeef1a5a55c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082413 Sep 01 08:21:20.744734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 661/1337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:20 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:20.821851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:20.822449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:20.829160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.829639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.830072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.830796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:20.831242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:20.831661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:20.894321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:20.902109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-add8b298-19d2-4940-80c9-644f6b9edaca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084062 Sep 01 08:21:20.902713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 677/1338] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:20 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:21.363845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:21.364449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:21.370407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.370880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.371302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.371979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.372417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.372829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.429153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:21.429700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:21.432194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:21.438857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.438857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.443915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.443915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.443915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.443915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.444311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:21.449770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:21.451341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:21.452695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9276dee-4c7b-4a89-93a9-c1dad1c3334e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092817 Sep 01 08:21:21.453335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 662/1339] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:21 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:21.469702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:21.470317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:21.477060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.477537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.477959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.478678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.479114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.479522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.504551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:21.512345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e1b4e72b-ee34-4db2-b7c5-cad4e9376876 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087080 Sep 01 08:21:21.512930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 678/1340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:21 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:21.525745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:21.526620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:21.533252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.533764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.534196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.534923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.535363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.535780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.543644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:21.551722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-10f311ef-1160-46bd-a9b6-f315bcd38ff2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086430 Sep 01 08:21:21.552297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 663/1341] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:21 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:21.600354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:21.608058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33ea41ef-d2d2-4726-b289-5aa4e6254893 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086802 Sep 01 08:21:21.609375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 679/1342] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:21 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:21.765954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:21.766509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:21.768365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:21.774011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.774521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.774956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.775641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.776089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.776508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.836600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:21.845213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ceeded9d-4e6a-4fb0-ad9c-442436df978f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084008 Sep 01 08:21:21.845774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 664/1343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:21 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:21.927001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:21.927599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:21.933957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.934461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.934886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.935553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:21.935991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:21.936400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:21.999635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.007734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e67b31fb-a826-4f00-bc78-07d054226ff3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084366 Sep 01 08:21:22.008337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 680/1344] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:21 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:22.476714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:22.477318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:22.483927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.484408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.484935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.485613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.486053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.486502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.533221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:22.534023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:22.539902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.540603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.541265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.542057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.542617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.543043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.551078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.559213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.560644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.562485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-66b44676-6fff-44af-9620-d9ef67ab8552 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088974 Sep 01 08:21:22.563045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 665/1345] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:22 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:22.574565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:22.575234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:22.581547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.582023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.582499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.583227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.583666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.584080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.605713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.614157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-72e0e82f-6156-4136-bf12-28d3f04d0582 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084821 Sep 01 08:21:22.614751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 681/1346] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:22 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:22.629927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:22.630548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:22.636984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.637898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.638735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.639838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.640315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.640829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.652738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.660715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ae026f74-5568-4f3c-b9ae-cf618ca51865 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090227 Sep 01 08:21:22.661272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 666/1347] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:22 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:22.702137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.709868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a702c30-2c16-48b6-ad7a-10544f7d928f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083719 Sep 01 08:21:22.710448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 682/1348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:22 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:22.866542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:22.867203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:22.873255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.873737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.874189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.874880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:22.875331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:22.875749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:22.940133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:22.947775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-db860881-8580-4427-bd14-6ffe194cf403 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085252 Sep 01 08:21:22.948327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 667/1349] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:22 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:23.029143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:23.029721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:23.036158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.036732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.037105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.037778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.038219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.038654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.098324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:23.105784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-598598bc-4b90-41ee-8207-b7a8827225c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080483 Sep 01 08:21:23.106345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 683/1350] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:23 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:23.585119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:23.585744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:23.592051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.592524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.594013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.594751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.595191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.595604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.635228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:23.635806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:23.642541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.643017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.643439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.644122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.644569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.644982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.656479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:23.664475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:23.665900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:23.667009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d68cfd8a-f5ba-44b3-bbba-f0547f560d3b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085819 Sep 01 08:21:23.667560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 668/1351] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:23 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:23.680834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:23.681606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:23.687792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.688262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.688826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.689523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.689965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.690407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.705758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:23.713422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fff62363-f174-4c3d-a9c8-a3d87bfee869 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082040 Sep 01 08:21:23.714247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 684/1352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:23 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:23.729854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:23.730402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:23.737165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.737645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.738072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.738793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.739242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.739657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.754462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:23.762021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c200fa41-d727-461b-9580-2cc79ef04248 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084967 Sep 01 08:21:23.762617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 669/1353] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:23 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:23.799497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:23.807067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-19d6d173-ef5a-4c1f-a15c-54f44faa683d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080979 Sep 01 08:21:23.807618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 685/1354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:23 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:23.968814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:23.969411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:23.975316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.975780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.976205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:23.976874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:23.977308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:23.977717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.036086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.039394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:24.044208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1cda2caf-1063-4904-8085-a4bc7b37e442 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.079248 Sep 01 08:21:24.044761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 670/1355] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:23 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:24.127220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:24.127856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:24.133830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.134329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.134762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.135443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.135887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.136302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.197233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.204799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b5fb905-735f-4804-a477-6895fd6440d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081939 Sep 01 08:21:24.205348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 686/1356] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:24 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:24.691248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:24.691795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:24.697665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.698135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.698605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.699291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.699731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.700144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.734904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:24.735664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:24.741676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.742276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.742716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.743408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.743856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.744276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.763280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.771377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.772800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.773896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f3da6a27-e3e9-4c43-bfb2-f2a696ada294 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087683 Sep 01 08:21:24.774476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 671/1357] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:24 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:24.782044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:24.782829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:24.789063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.789543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.789972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.790741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.791193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.791608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.806414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.815063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd38342f-7aed-4039-a0f2-383fa1fc69e4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084393 Sep 01 08:21:24.815818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 687/1358] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:24 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:24.832503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:24.833107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:24.839443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.839956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.840381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.841076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:24.841526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:24.841949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:24.853593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.862060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ad8e9ae-6af2-439a-9f31-4aeccb646664 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083653 Sep 01 08:21:24.862659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 672/1359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:24 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:24.902614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:24.910795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1c803c1a-3281-4b75-a99e-0dcf2fe24a00 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081976 Sep 01 08:21:24.911349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 688/1360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:24 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:25.065166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:25.065769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:25.071625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.072097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.072528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.073196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.073636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.074075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.137822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:25.146112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c509984-0592-49dc-a12f-86b8db636c7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084985 Sep 01 08:21:25.146699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 673/1361] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:25 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:25.225719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:25.226337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:25.232427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.232896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.233737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.234411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.234851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.235267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.294934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:25.302554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-527db490-e48e-4708-be4c-6641370598cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080692 Sep 01 08:21:25.303114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 689/1362] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:25 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:25.797506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:25.798145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:25.804597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.805077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.805506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.806192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.806745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.807285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.835508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:25.836113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:25.844121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.844675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.845107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.845799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.846247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.846689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.870053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:25.878525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:25.879957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:25.881053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c1eab4f-2f1a-46e6-86d1-4372b4de66b3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088295 Sep 01 08:21:25.881600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 674/1363] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:25 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:25.886029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:25.886652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:25.893508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.893987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.894778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.895477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.895919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.896332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.908659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:25.916220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-233f66f0-9723-476c-9c6a-7013647eaa3f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084667 Sep 01 08:21:25.916772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 690/1364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:25 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:25.932747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:25.933345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:25.939687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.940163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.940585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.941356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:25.941801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:25.942215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:25.946395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:25.959315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:25.967018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d7bfcdf-31c1-4137-8209-2e40d87ef761 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.084476 Sep 01 08:21:25.968083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 675/1365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:25 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:26.002818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:26.010475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-99281b64-1cb3-4da7-8837-7c1dbb72a677 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081530 Sep 01 08:21:26.010957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 691/1366] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:25 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:26.166251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:26.166887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:26.173518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.173994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.174458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.175152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.175594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.176008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.235932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:26.243541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a2dba79-9cdd-4fe1-a186-b9ae1bfb3217 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081180 Sep 01 08:21:26.244096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 676/1367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:26 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:26.323571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:26.324169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:26.330691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.331160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.331584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.332256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.332698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.333112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.392067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:26.399508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a4e0a813-ccde-43b6-81ec-e7fb13ba2b68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.079751 Sep 01 08:21:26.400052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 692/1368] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:26 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:26.903797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:26.904393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:26.911024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.911514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.911932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.912624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.913068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.913484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.942025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:26.943674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:26.949884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.950400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.950833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.951524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:26.951996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:26.952423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:26.980857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:26.990448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:26.991890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:26.992993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a53f5e79-b324-4229-9623-bf14f96532cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.093131 Sep 01 08:21:26.993551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 677/1369] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:26 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:26.997950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:26.998594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:27.004806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.005287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.005717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.006443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.006905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.007310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.013655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:27.021698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-be790058-f79a-420a-876e-d8bccbfbc5fb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.087137 Sep 01 08:21:27.022357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 693/1370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:26 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:27.030884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:27.031605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:27.037427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.037972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.038500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.039250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.039775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.040262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.067935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:27.075572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8dc7c60-0a3a-4a31-a638-aeb5b397701b tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081046 Sep 01 08:21:27.076135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 678/1371] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:26 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:27.100624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:27.108272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2eddad78-9dc4-482b-bca7-36a94acb0695 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081432 Sep 01 08:21:27.108885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 694/1372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:27 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:27.266336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:27.266893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:27.272721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.273189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.273613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.274306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.274752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.275163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.336311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:27.344765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-efa88995-fd14-4fa8-ad0c-c7b82396d699 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082890 Sep 01 08:21:27.345321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 679/1373] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:27 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:27.420666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:27.421483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:27.427453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.427927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.428354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.429033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:27.429477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:27.429894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:27.490433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:27.499687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-72682423-6fb5-4b0b-ba0e-42a8b89e6cbe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082272 Sep 01 08:21:27.500484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 695/1374] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:27 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:28.016516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:28.017148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:28.023230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.023710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.024185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.024832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.025272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.025691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.042747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:28.043349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:28.049204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.049678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.050104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.050811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.051255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.051734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.086722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.096071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.097590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.098717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15db6d3f-c556-4650-8535-a019d8d3cc08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086728 Sep 01 08:21:28.099433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 680/1375] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:28 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:28.103751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:28.104344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:28.110574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.111110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.111460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.112146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.112612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.113026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.114323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.121846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44eb7e53-fee9-4948-b8b2-c6b422e025da tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.082879 Sep 01 08:21:28.122413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 696/1376] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:28 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:28.131033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:28.131652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:28.137647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.138125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.138588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.139281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.140466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.140894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.178170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.186041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a99af3a7-0c2e-4b56-b8e6-13303bc8df49 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085624 Sep 01 08:21:28.187396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 681/1377] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:28 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:28.307393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.315506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-782c5c3e-8a30-420f-9f99-24bcb549f1e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.188177 Sep 01 08:21:28.316058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 697/1378] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:28 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:28.365049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:28.365649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:28.371496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.371963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.372380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.373046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.373492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.373948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.440593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.448063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a7e44faa-481c-4258-8153-5f9fc7e12f21 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086710 Sep 01 08:21:28.448618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 682/1379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:28 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:28.520789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:28.521534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:28.527576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.528048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.528479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.529155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:28.529599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:28.530633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:28.589715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:28.597821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6f35a42e-0dd2-421c-91e4-6d25498d4346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080868 Sep 01 08:21:28.598422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 698/1380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:28 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:29.121133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:29.121718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:29.128379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.128856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.129294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.129981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.130479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.130896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.144275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:29.144885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:29.150718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.151206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.151638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.152321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.152796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.153196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.193495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.202083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.203955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.205065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2cc9e92b-b334-4d6e-93aa-6378e8c5d526 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087913 Sep 01 08:21:29.205624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 683/1381] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:29 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:29.209967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:29.210609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:29.216967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.217994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.218626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.219531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.219999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.220425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.222338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.230286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b39d92c-9b0b-4603-a847-577070f7a53b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089865 Sep 01 08:21:29.230954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 699/1382] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:29 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:29.282222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.289737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-448882d7-9bc4-4423-8790-daba1c0abf59 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083174 Sep 01 08:21:29.290309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 684/1383] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:29 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:29.336521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:29.337124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:29.344116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.344596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.345026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.345706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.346154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.346608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.406425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.414016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd46d2f4-22c6-4891-a6e2-c50fd4ca93cc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081230 Sep 01 08:21:29.414607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 700/1384] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:29 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:29.469282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:29.469888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:29.475769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.476246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.476679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.477375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.477802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.478218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.538430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.546604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fad25d82-bd8a-4ceb-91af-be92639d4af5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081046 Sep 01 08:21:29.547167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 685/1385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:29 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:29.619924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:29.620525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:29.626630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.627097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.627523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.628195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:29.628635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:29.629046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:29.691647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:29.699233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f9e2ff46-7d81-4b48-bb05-ebaddec38fa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084293 Sep 01 08:21:29.699783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 701/1386] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:29 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:30.228973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:30.229579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:30.237891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.238392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.238817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.239502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.239940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.240351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.252745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:30.253354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:30.259308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.259785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.260220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.260907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.261380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.261799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.310542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.319402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.320836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.321928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-180658a4-7841-45c1-be8c-95ffb9305ab4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.096840 Sep 01 08:21:30.322516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 686/1387] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:30 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:30.326882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:30.327882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:30.330723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.333714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.334625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.334745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.335337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.335787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.336210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.339293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-865c8aab-ea12-4326-86ab-ac9e0bc63511 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.091434 Sep 01 08:21:30.339855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 702/1388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:30 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:30.355136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:30.399284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.406983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7dbb4506-37ef-4c9d-aa39-8f898958554e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.083537 Sep 01 08:21:30.407544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 687/1389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:30 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:30.435140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:30.435740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:30.442511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.442984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.443410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.444082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.444527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.444936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.505160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.512848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e9a5797-b54a-4bd6-8c5b-e99f830a470a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081526 Sep 01 08:21:30.513394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 703/1390] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:30 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:30.567496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:30.568082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:30.574224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.574727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.575182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.575865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.576305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.576719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.638981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.647016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-372e69cb-92dc-43ed-85a5-116ba05ea3c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083417 Sep 01 08:21:30.647569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 688/1391] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:30 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:30.720017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:30.720621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:30.726592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.727065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.727490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.728166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:30.728611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:30.729027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:30.788318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:30.795884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-497e990c-d16d-4b4f-a1a7-d7f1bda5a020 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080249 Sep 01 08:21:30.796533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 704/1392] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:30 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:31.345056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:31.345684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:31.351577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.352051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.352479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.353177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.353620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.354040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.361195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:31.361906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:31.367979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.368456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.368885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.369568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.370008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.370453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.416810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.426391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.427829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.428925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb560e93-df1f-49c5-96cf-49ae5ae2a100 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087966 Sep 01 08:21:31.429472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 689/1393] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:31 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:31.433746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:31.434361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:31.442518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.443168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.443723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.444550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.444987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.445401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.448654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.457207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db7613a6-9ad0-4b16-921f-7747cfaca70c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.100597 Sep 01 08:21:31.457956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 705/1394] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:31 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:31.509459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.517141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-850ee18b-1538-4211-8c48-e5968be3e3c7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086738 Sep 01 08:21:31.517728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 690/1395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:31 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:31.532834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:31.533439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:31.539413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.539887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.540313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.540993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.541436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.541850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.605626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.613780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1c6b5934-38fe-4f3f-9d4f-9de0decb3dae tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084772 Sep 01 08:21:31.614357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 706/1396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:31 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:31.667963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:31.668482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:31.675010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.675480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.675907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.676582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.677026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.677443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.736432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.744376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8c75a94-9d9b-4196-bb7b-5ab49b910358 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080217 Sep 01 08:21:31.744948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 691/1397] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:31 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:31.816831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:31.817431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:31.823465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.823940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.824365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.825040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:31.825483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:31.825896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:31.885674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:31.888994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:31.894675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a74b7074-cb3f-49d2-b467-b3a4eef944d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081628 Sep 01 08:21:31.895233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 707/1398] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:31 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:32.452329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:32.452923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:32.458797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.459267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.459687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.460356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.460799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.461212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.477440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:32.478043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:32.484369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.484844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.485270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.485949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.486430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.486845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.527651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.536060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.537486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.538608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5632fb57-787f-4cd8-88b6-ccdd1373106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090248 Sep 01 08:21:32.539436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 692/1399] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:32 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:32.543860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:32.544454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:32.550985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.551469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.551892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.552739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.553022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.553441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.555453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.563767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-904bffd6-6fd9-430e-ac43-dbde530210b3 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.090254 Sep 01 08:21:32.564324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 708/1400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:32 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:32.615248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.622889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e2f48e4e-5894-4ceb-87d8-f40628b5293a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082626 Sep 01 08:21:32.623444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 693/1401] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:32 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:32.634570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:32.635206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:32.641401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.641866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.642309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.642985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.643424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.643844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.705806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.713590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7ac6e39-8076-4e3b-a018-c402fb532d09 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082476 Sep 01 08:21:32.714136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 709/1402] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:32 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:32.764940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:32.766046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:32.771911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.772388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.772819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.773499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.773949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.774410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.833960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.841677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0be5ed9f-77fb-42a5-b0ec-7591de824bc6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080705 Sep 01 08:21:32.842236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 694/1403] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:32 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:32.915447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:32.916085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:32.921954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.922459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.922892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.923572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:32.924017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:32.924433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:32.988075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:32.995944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2eb57843-194a-416f-8a9c-6d03bd24c711 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084448 Sep 01 08:21:32.996505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 710/1404] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:32 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:33.562078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:33.562696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:33.568646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.569139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.569548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.570224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.570696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.571115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.584299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:33.585042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:33.591218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.591694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.592119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.593361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.593781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.594190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.633259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:33.642048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:33.643641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:33.644744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-df5759db-9ee0-4c0f-801d-5e95b8c60777 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086600 Sep 01 08:21:33.645297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 695/1405] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:33 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:33.649823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:33.650456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:33.656982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.657620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.657898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.658620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.659070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.659489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.660830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:33.668466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8143445e-2c42-466c-9ce0-b5d15c8e2a9d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088033 Sep 01 08:21:33.669021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 711/1406] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:33 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:33.719475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:33.727085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c6e9e22-3c5f-4b77-a730-ac651811ab98 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.080782 Sep 01 08:21:33.727600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 696/1407] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:33 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:33.734747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:33.735430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:33.741481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.741952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.742442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.743120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.743564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.743980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.805276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:33.813208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f9cb1c5d-726d-46d5-b75c-b18affcecaa3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082974 Sep 01 08:21:33.813761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 712/1408] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:33 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:33.862310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:33.862919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:33.868872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.869349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.869777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.870498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:33.870944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:33.871360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:33.931715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:33.939510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-74738369-0fc1-4adf-b60e-9f3d8c2cce1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081017 Sep 01 08:21:33.940057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 697/1409] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:33 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:34.017761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:34.018314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:34.024180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.024648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.025073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.025748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.026188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.026632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.087400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:34.096705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f0e34ba-ff29-467e-9d71-c00d14a4d1e8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083308 Sep 01 08:21:34.097253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 713/1410] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:34 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:34.667691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:34.668302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:34.675046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.675522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.675956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.676637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.677088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.677509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.689565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:34.690164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:34.696112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.696585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.697012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.697687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.698127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.698574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.739460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:34.747871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:34.749892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:34.751095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c14ef257-fc42-4da0-8081-202fc40c2e4e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.087297 Sep 01 08:21:34.751662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 698/1411] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:34 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:34.756026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:34.756620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:34.762414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.762888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.763309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.763985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.764675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.765141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.769012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:34.776583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-693a2fe9-5c51-46b0-85e4-d3fb9788c9e2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.091573 Sep 01 08:21:34.777181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 714/1412] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:34 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:34.826022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:34.832762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:34.833372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:34.834181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fcb2396a-0599-44c6-99d4-b8cdbf4d417f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081534 Sep 01 08:21:34.834958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 699/1413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:34 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:34.839550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.840028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.840463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.841151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.841596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.842015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.901598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:34.909729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-933a2fe5-e294-480f-a519-75da706349c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080734 Sep 01 08:21:34.910302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 715/1414] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:34 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:34.960727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:34.961408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:34.968359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.968830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.969245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:34.969918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:34.970387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:34.970801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.031931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:35.039425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d997810a-849d-47cf-b88b-adad3c1369c5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082638 Sep 01 08:21:35.039973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 700/1415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:34 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:35.117765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:35.118390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:35.124412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.124877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.125302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.125977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.126469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.126883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.192506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:35.200014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e6dc6ffc-8ae6-4747-83a5-fe25fa1b8249 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086051 Sep 01 08:21:35.200570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 716/1416] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:35 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:35.773728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:35.774335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:35.780200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.780669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.781092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.781761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.782202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.782635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.798370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:35.799012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:35.805041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.805533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.805962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.806691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.807265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.807699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.844665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:35.852891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:35.854477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:35.855508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a70813bc-7600-4ef2-85ef-e102c9ce270d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.085792 Sep 01 08:21:35.856286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 701/1417] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:35 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:35.860907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:35.861503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:35.867441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.867982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.868411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.869096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.869549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.869964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.872636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:35.880873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dab652a5-e240-4e7d-9a0e-7d6becd87c00 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086513 Sep 01 08:21:35.881590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 717/1418] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:35 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:35.930363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:35.930753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:35.931517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:35.937955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.938467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.938691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9039567b-eab2-4f45-813a-da46b8ea8d5a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.081275 Sep 01 08:21:35.938897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:35.939253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 702/1419] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:35 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:35.939623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:35.940075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:35.940496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.001772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:36.009433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6fc9bdbd-eac9-43f3-aa8e-bb5b5d548451 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082498 Sep 01 08:21:36.009996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 718/1420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:35 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:36.060271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:36.060880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:36.067541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.068015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.068444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.069125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.069568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.069981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.132617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:36.140409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7bb23729-ab24-4763-9861-91f98afc5dde tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.083967 Sep 01 08:21:36.140967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 703/1421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:36 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:36.221037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:36.221591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:36.227617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.228167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.228768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.229455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.229960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.230619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.291974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:36.300106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf8906a7-e623-488f-9949-e8223b94ef36 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083063 Sep 01 08:21:36.300674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 719/1422] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:36 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:36.878570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:36.879162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:36.885069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.885540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.885966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.886656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.887095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.887506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.892357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:36.902564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:36.903168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:36.909865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.910372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.910806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.911490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.911960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.912358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.957358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:36.965758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:36.967211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:36.969034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c6d7ca2d-48b0-49d9-bb5a-7629daad9043 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.094956 Sep 01 08:21:36.969707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 704/1423] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:36 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:36.974129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:36.974854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:36.977699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:36.981094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.981237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.981664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.982373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:36.982873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:36.985196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:36.985444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-310e50fd-b5f5-4963-b3b5-a02dd3e1704b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086611 Sep 01 08:21:36.986008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 720/1424] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:36 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:37.031076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:37.031724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:37.037787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:37.038289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:37.038733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:37.039428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:37.039876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:37.040298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:37.050890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:37.058511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2a5bb186-b263-44cb-853a-10aa835365cf tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087769 Sep 01 08:21:37.059073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 705/1425] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:36 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:37.102155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:37.110221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c3a61ef2-e4bc-485e-9975-c35580d47ece tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083824 Sep 01 08:21:37.110801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 721/1426] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:37 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:37.166502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:37.167027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:37.173270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:37.173748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:37.174184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:37.174901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:37.175345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:37.175761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:37.236943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:37.244541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d52d1785-0e0e-4ffd-a393-d1165f79187c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082090 Sep 01 08:21:37.245087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 706/1427] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:37 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:37.320925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:37.321529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:37.328164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:37.328634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:37.329062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:37.329740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:37.330185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:37.330629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:37.390705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:37.398133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ad3833ad-8cfe-412d-a378-288b03580f7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081066 Sep 01 08:21:37.398710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 722/1428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:37 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:37.991898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:37.992498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:37.998422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:37.998909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:37.999331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.000009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.000455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.000868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.006103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:38.007043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:38.013411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.013888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.014344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.015119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.015570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.015995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.063470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.071709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.073121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.074211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c8c56b52-526c-40d4-b80c-0177bdc3deb5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.086230 Sep 01 08:21:38.074793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 707/1429] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:37 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:38.079177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:38.079769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:38.085519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.085988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.086460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.087750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.087750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.088379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.093949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.101354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-107a3e7d-f566-4e2f-a1fd-329aef3ac86a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.099777 Sep 01 08:21:38.102115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 723/1430] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:38 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:38.130784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:38.131398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:38.137665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.138157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.138620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.139337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.139832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.140256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.152914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.159460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:38.162207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7dc3827a-0c6c-4d0d-a07c-fc3999866265 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086364 Sep 01 08:21:38.162955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 708/1431] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:38 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:38.203104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.210608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4f2834e-9b4e-4abc-a8e2-6b684d77c4ac tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083652 Sep 01 08:21:38.211166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 724/1432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:38 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:38.265693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:38.266321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:38.272170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.272639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.273059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.273726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.274167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.274603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.334598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.342939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-acbe0171-8afc-411e-bff7-9fa8a0edb6f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.081296 Sep 01 08:21:38.343489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 709/1433] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:38 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:38.418749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:38.419347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:38.425203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.425681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.426104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.426805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:38.427287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:38.427683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:38.489721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:38.497360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21dd73a5-c7d3-4b4a-9de1-be33515ad44c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082355 Sep 01 08:21:38.497922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 725/1434] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:38 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:39.097965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:39.098600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:39.104689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.105172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.105604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.106321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.106772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.107188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.124896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:39.125636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:39.131575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.132061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.132496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.133193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.133658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.134083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.172736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.181000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.182440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.183526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d64700c-604e-41a7-aa85-609ef72379ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089494 Sep 01 08:21:39.184074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 710/1435] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:39 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:39.189171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:39.189765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:39.195692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.196167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.196592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.197274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.197715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.198128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.200629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.208603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-187a9f25-c353-43d8-abf8-fbeceb1f0be4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088108 Sep 01 08:21:39.209181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 726/1436] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:39 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:39.231656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:39.232260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:39.238957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.239433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.239864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.240561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.241000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.241427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.259673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.267303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4043431d-d26c-4254-aeef-57acce9f0df0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.082249 Sep 01 08:21:39.267866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 711/1437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:39 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:39.300792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.308345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e89fd352-4e84-4582-8bf5-052d0864875e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080397 Sep 01 08:21:39.308908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 727/1438] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:39 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:39.363210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:39.363733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:39.369711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.370177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.370704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.371378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.371816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.372232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.434019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.442330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46665bb8-503f-4775-89db-54c2c92e9047 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.082824 Sep 01 08:21:39.442897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 712/1439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:39 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:39.517463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:39.518083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:39.519947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:39.525321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.525797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.526336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.526961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:39.527423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:39.527851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:39.587505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:39.595563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-574293cf-e6d6-4293-8f93-45e3a334bbdb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082415 Sep 01 08:21:39.596121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 728/1440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:39 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:40.206884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:40.207518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:40.213880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.214384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.214813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.215507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.215952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.216371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.228913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:40.229514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:40.236179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.236657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.237084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.237782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.238223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.238670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.289735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.298456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.299885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.300981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a497f85-170b-47cd-b45b-f721c7d716e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.098179 Sep 01 08:21:40.301537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 713/1441] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:40 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:40.306083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:40.307393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:40.309226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.309371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:40.314808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.315287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.316216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.316415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.316837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.317252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.320296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1064b6e3-46ea-4242-9eae-bbb6c7ce12fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.095139 Sep 01 08:21:40.320860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 729/1442] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:40 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:40.328435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:40.329123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:40.335055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.335528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.335955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.336636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.337102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.337506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.384333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.392783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9b58f27a-8da3-48b0-8f51-2c50b7ee9b70 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090219 Sep 01 08:21:40.393349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 714/1443] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:40 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:40.410814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.418369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c053a0d-a905-4152-bade-70cc9fa42a08 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.093502 Sep 01 08:21:40.418929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 730/1444] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:40 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:40.464636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:40.465161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:40.471223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.472157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.472157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.472796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.473246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.473667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.533655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.541192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-513e780d-8382-4670-ae98-7c9a152c4f4c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.080678 Sep 01 08:21:40.541754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 715/1445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:40 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:40.615553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:40.616157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:40.622010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.622517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.622942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.623615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:40.624052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:40.624461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:40.683236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:40.690668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7bccf3cd-4e6f-4590-a6e1-f72e4105d64c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.078926 Sep 01 08:21:40.691213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 731/1446] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:40 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:41.324487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:41.325110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:41.331213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.331704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.332108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.332788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.333228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.333640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.340823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:41.341521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:41.347818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.348312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.349504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.349504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.349986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.350452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.415953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.425134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.426596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.427705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0405a5d8-4381-4220-a749-069f24178b2f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.107105 Sep 01 08:21:41.428473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 716/1447] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:41 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:41.432763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:41.433377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:41.434924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.441845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.442353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.442789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.443643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d0a1a197-7a22-4658-811e-07314af73713 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.106824 Sep 01 08:21:41.443911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.444588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.444700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 732/1448] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:41 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:41.448871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:41.449504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:41.454786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.456749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.457232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.457661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.458444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.458819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.459232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.538570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.540090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.547321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad83c4bd-028c-46f7-97d3-a54a42648953 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.118011 Sep 01 08:21:41.547906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 717/1449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:41 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:41.549297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3f0e9ed5-dea5-46ab-aa64-1ab74ccc6fcb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.103886 Sep 01 08:21:41.549868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 733/1450] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:41 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:41.565401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:41.566211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:41.572992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.573477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.573910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.574720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.575089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.575503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.636407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.644064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c6923035-e1e7-4421-8f95-79ff223d39a5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.085303 Sep 01 08:21:41.644622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 718/1451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:41 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:41.711566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:41.712165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:41.718831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.719299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.719723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.720397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:41.720835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:41.721252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:41.783607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:41.791141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fcc4c6c4-be91-4679-9221-fbaafcc050d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083369 Sep 01 08:21:41.791698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 734/1452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:41 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:42.461489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:42.462195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:42.469492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.469973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.470113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:42.470586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.470930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:42.471114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.471546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.471959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.478831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.479317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.479743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.480441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.480885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.481564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.541342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.550622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.552081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.553212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3caed212-2fac-40bb-95aa-bfddeb215ff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.095924 Sep 01 08:21:42.553782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 719/1453] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:42 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:42.567553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.574061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:42.575214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:42.576055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac845310-6957-4303-80ee-42232dca6d1d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.110833 Sep 01 08:21:42.577438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 735/1454] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:42 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:42.581992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:42.582653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:42.584633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.585835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.586040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.587125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.587850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.588521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.589286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.589857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.590481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.591108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.591558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.592006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.679419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.681370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.684938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:42.689011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7b6094b-9446-4d6a-a693-21046fae200d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.110737 Sep 01 08:21:42.689601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 736/1455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:42 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:42.690735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c3bc0c39-1c00-4459-83cc-885c88799936 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.123499 Sep 01 08:21:42.694322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 720/1456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:42 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:42.694525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:42.695050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:42.702293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.702869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.703311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.704031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.704488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.704909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.771759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.779470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4f69f35-3739-4743-bd2f-f05955d3bfe3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088854 Sep 01 08:21:42.780064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 737/1457] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:42 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:42.812205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:42.812634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:42.819463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.819966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.820396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.821079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:42.821524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:42.821937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:42.883535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:42.891639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7c875312-6b49-48aa-962d-93b5c05e231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084127 Sep 01 08:21:42.892218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 721/1458] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:42 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:43.577192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:43.577788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:43.583903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.584380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.584807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.585490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.585930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.586369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.599113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:43.599721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:43.605964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.606485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.606920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.608164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.608625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.609045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.659266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.667536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.668945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.670044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf30b62f-f259-43b0-a60b-f19226322532 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.097002 Sep 01 08:21:43.671153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 738/1459] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:43 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:43.695353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.703166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-052d9c20-e1ec-4759-85df-83d8c597931a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.107931 Sep 01 08:21:43.703729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 722/1460] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:43 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:43.710608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:43.711587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:43.712918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:43.713480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:43.717993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.718515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.718946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.719649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.720092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.720500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.724273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.725238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.726065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.727302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.728129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.728439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.783089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.791000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a8c06aee-df8f-4f30-af43-a62455f78e81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084298 Sep 01 08:21:43.791789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 739/1461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:43 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:43.800272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:43.800881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:43.807165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.807644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.808140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.808842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.809289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.809707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.814571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.822285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b157255a-f184-405c-bd18-89031933bcbb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.114317 Sep 01 08:21:43.822855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 723/1462] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:43 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:43.873190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.881353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a369a4d-d2a7-4963-aa99-40bfb5fd57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084769 Sep 01 08:21:43.881926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 740/1463] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:43 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:43.912077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:43.912680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:43.918774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.919228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.919578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.920303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:43.920746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:43.921163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:43.985330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:43.993017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2164e77a-7962-4e10-9bfd-84a59a85dc84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084742 Sep 01 08:21:43.993577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 724/1464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:43 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:44.693130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:44.693725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:44.699727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.700214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.700635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.701315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.702389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.702809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.707021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:44.724224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:44.724988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:44.731179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.731663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.732097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.732841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.733447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.733873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.783684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:44.793208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:44.794819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:44.796082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1631602e-5215-4e5f-a299-e6dc3e435cc4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.106809 Sep 01 08:21:44.796695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 741/1465] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:44 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:44.803244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:44.812718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f14fa1b-ef33-4ae0-b386-2349b63ce995 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092149 Sep 01 08:21:44.813665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 725/1466] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:44 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:44.816767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:44.817400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:44.823531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.824009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.824445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.825141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.825590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.826011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.844003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:44.844608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:44.850935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.851412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.851838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.852524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.852963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.853376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.890821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:44.900005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1372297b-2987-4dae-a83c-796a29798054 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090966 Sep 01 08:21:44.900609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 742/1467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:44 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:44.905808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:44.906708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:44.912766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.913242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.913666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.914390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:44.914836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:44.915270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:44.918542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:44.926716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a987667c-eaa7-4451-866c-e00f47481765 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087378 Sep 01 08:21:44.927295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 726/1468] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:44 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:44.983661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:44.991403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc093c59-4b98-4600-8ba4-62c0f66b99aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089801 Sep 01 08:21:44.991976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 743/1469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:44 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:45.014499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:45.015109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:45.021392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.021863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.022332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.023027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.023463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.023875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.090614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:45.099520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-004b95b6-bd4c-45fc-8f8e-2205c423d927 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089177 Sep 01 08:21:45.100107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 727/1470] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:45 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:45.821504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:45.822104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:45.829152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.829648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.830084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.830829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.831277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.831699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.833392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:45.834002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:45.840590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.841079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.841534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.842906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.843359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.843784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.908119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:45.923744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:45.924161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:45.926597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:45.928649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-48db8e44-a80a-445f-affc-6747d73a0092 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.110738 Sep 01 08:21:45.929807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 744/1471] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:45 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:45.937377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e3da507e-c4d0-4b86-9826-f0dd543bc183 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.107700 Sep 01 08:21:45.938685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 728/1472] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:45 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:45.938873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:45.939812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:45.949666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.950542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.951792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.953049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.953817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.954603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.961134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:45.961747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:45.971868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.972677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.973417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:45.974541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:45.975213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:45.975886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.029273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:46.038105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-052d3603-0d20-47d3-ad6f-d65d718df2ff tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.106933 Sep 01 08:21:46.039706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 745/1473] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:45 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:46.043264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:46.044064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:46.050361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.050855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.051290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.051998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.052450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.052881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.057785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:46.065631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9290665-af38-485a-aa0f-88686acd577a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.108334 Sep 01 08:21:46.066204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 729/1474] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:45 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:46.117700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:46.121276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:46.121884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:46.126485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-46e5f10a-75e7-4a55-a552-4f8bb5ec53aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086709 Sep 01 08:21:46.127247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 746/1475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:46 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:46.128737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.129223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.129663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.130382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.130857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.131246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.194345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:46.202687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a8a95f1-9ab0-411c-8948-c46f1850b47b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085023 Sep 01 08:21:46.203272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 730/1476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:46 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:46.952738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:46.953410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:46.959538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.960018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.960446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.961035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:46.961478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.961559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.961647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:46.961965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.967942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.968543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.968996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:46.969680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:46.970123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:46.970569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.153205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.162648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.164088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.165208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf2c5d27-29a1-4f87-b499-c86a984f9074 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.217183 Sep 01 08:21:47.165775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 747/1477] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:46 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:47.172707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.173003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:47.173003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:47.178485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.178970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.179400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.180099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.180545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.180833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-12e25e02-fca3-46f2-afd4-cc8506b8a3d4 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.223338 Sep 01 08:21:47.180947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.181594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 731/1478] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:46 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:47.186556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:47.187269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:47.193388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.194016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.194578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.195290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.195730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.196176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.253587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.261316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a966a4f2-8b7d-4952-b31d-cbb6341e9375 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.094497 Sep 01 08:21:47.261876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 748/1479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:47 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:47.266976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:47.267563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:47.274571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.275060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.275541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.275683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.276192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.276680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.277058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.286739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0dab2246-de10-496b-8d53-62d9a28e623e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.103963 Sep 01 08:21:47.287324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 732/1480] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:47 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:47.292029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:47.292634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:47.299130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.299633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.300050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.300833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:47.301331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:47.301704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:47.345685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.354021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b2e09078-5027-43b6-8062-a3164b5e07c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.091048 Sep 01 08:21:47.354641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 749/1481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:47 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:47.388549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:47.397495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26b73ce7-c9e7-41da-bfa7-d02bdb6d0414 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.109151 Sep 01 08:21:47.398067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 733/1482] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:47 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:48.189240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:48.189851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:48.196170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.196652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.197086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.197787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.198234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.198685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.202777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:48.203516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:48.210205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.210770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.211296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.212131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.212641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.213376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.299642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.301140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.308189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a49b153-b398-47a5-a5dd-46f19f13108f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.109225 Sep 01 08:21:48.311299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 734/1483] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:48 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:48.312773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.314290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.314469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:48.315017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:48.315433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bff56655-a706-4516-ac24-08bffa2b5f8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.131336 Sep 01 08:21:48.316263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 750/1484] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:48 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:48.320533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:48.321138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:48.327596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.328076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.328538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.329203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.329647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.330066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.335675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.336161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.336592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.337296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.337747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.338469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.405850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.413620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9889cda3-5ac7-438d-80db-12c108672416 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.096613 Sep 01 08:21:48.423039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 751/1485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:48 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:48.423039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:48.423039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:48.423676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.426152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.427393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.427393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.428784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.429238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.429663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.432358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f070990-41c9-42a2-ab1a-0dbe0b6b3e63 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.122553 Sep 01 08:21:48.433206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 735/1486] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:48 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:48.442726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:48.442726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:48.445941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.446492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.447435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.447644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:48.448052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:48.448462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:48.503486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.511640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-abc30198-b156-4004-983b-92413150594f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096368 Sep 01 08:21:48.512211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 752/1487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:48 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:48.524453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:48.534517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b103597f-5251-4f92-9a39-5a9e285e1921 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.100527 Sep 01 08:21:48.535126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 736/1488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:48 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:49.330113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:49.330970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:49.337013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.337296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:49.337750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.338170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.338315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:49.338903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.339351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.339770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.346522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.346998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.347423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.348117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.348560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.348974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.367807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:49.427426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.429069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.435477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-45a2f61a-12a9-4943-a8ed-5b2b982f42b6 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.109812 Sep 01 08:21:49.437711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 753/1489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:49 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:49.438622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.440085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.441215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8673030f-daad-4805-b198-029a24008ee0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.107718 Sep 01 08:21:49.443069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:49.443971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:49.450300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 737/1490] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:49 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:49.451111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.452487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.453125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.453841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.454308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.454807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.456839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:49.457462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:49.464387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.464878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.465315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.466038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.466587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.467194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.531480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.539694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a6ae6e8-595d-4479-8576-6206010a289e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.102069 Sep 01 08:21:49.540445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 754/1491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:49 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:49.545845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:49.546801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:49.549334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.553447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.553942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.554443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.555160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.555615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.556037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.563234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f579edb-60b1-42fb-8a54-d85a0c4a8c3f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.109816 Sep 01 08:21:49.564343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 738/1492] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:49 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:49.569009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:49.569619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:49.577378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.577791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.578234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.578977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:49.579433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:49.579858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:49.624338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.633073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c916a504-b5c7-4e47-a697-96477b56afbf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.091457 Sep 01 08:21:49.633776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 755/1493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:49 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:49.669279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:49.678216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04be6acc-64b7-464f-85cf-0ce1bca244a9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.112915 Sep 01 08:21:49.678803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 739/1494] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:49 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:50.458555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:50.459424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:50.465342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:50.465955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:50.466139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.466600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.467073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.468001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.468277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.468637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.472597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.473085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.473527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.474248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.474866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.475501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.543781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.553053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-57665802-1f05-434a-897c-41b0f54c66c7 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.098540 Sep 01 08:21:50.553633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 756/1495] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:50 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:50.565552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.580002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:50.580721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:50.582545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.584739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.586341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c69343d-04bb-4e6d-8c4a-43ec0e37e7e1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.125115 Sep 01 08:21:50.587391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 740/1496] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:50 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:50.589012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.589858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.590710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.592541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.593444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:50.593644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.594056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:50.594357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.600745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.601231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.601657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.602392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.602838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.603252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.691015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.703614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e75453c4-422c-4b87-94b2-d49ba119ca34 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.114597 Sep 01 08:21:50.704689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 741/1497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:50 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:50.711508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:50.712557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:50.713960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.721460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:50.723387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.724237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.724968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.726034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.726627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.727230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.731019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce8b9713-d79e-47b4-b8ae-9196e3af06c2 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.169171 Sep 01 08:21:50.731601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 757/1498] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:50 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:50.736959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:50.737565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:50.744392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.744875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.745301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.746000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:50.746482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:50.747424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:50.832791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.834440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:50.840974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-acba6dd8-f53d-4e6a-addb-00de5452526c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.135085 Sep 01 08:21:50.841558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 742/1499] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:50 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:50.842546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8e7ff0d9-b3fd-4563-b884-ceb3f6596383 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.109882 Sep 01 08:21:50.843126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 758/1500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:50 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:51.586678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:51.587562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:51.594597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.595086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.595527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.596231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.596682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.597105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.618696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:51.619301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:51.625449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.625940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.626398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.627099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.627546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.627962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.661325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.669249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d7e557b5-cdb3-40da-af31-891c4028d8bb tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086317 Sep 01 08:21:51.669862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 743/1501] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:51 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:51.693229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.701535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.703351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.704840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d1fc0bd-ef84-4e41-bb1b-ffa2a650219b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.090040 Sep 01 08:21:51.705499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 759/1502] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:51 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:51.737559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:51.738059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:51.744310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.744785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.745213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.745905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.746374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.746792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.764983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:51.766097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:51.776321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.777192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.777970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.779936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.780697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.781407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.815253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.824948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-165f79da-0cc7-43eb-b6af-bb35236e4b0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.091213 Sep 01 08:21:51.825827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 744/1503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:51 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:51.863099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:51.863700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:51.876535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.877501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.878200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.879498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.880343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.880528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.881114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.888538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e44ac4c9-fdd8-48ef-9c74-0b8ddf24caec tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.131191 Sep 01 08:21:51.890000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 760/1504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:51 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:51.894420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:51.895019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:51.901765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.902700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.902815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.903715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:51.905125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:51.905608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:51.977346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.991295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:51.992010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f8764cb1-5c2a-4c82-a14a-a8b2dc2be6ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.132501 Sep 01 08:21:51.993026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 745/1505] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:51 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:51.999815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cdd290ad-2c3b-4bc9-a38d-fcc263d49a44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.109000 Sep 01 08:21:52.000398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 761/1506] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:51 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:52.695610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:52.696658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:52.706851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.707600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.708296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.709563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.710441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.711208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.744314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:52.745145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:52.755222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.756074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.756803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.758076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.758889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.759640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.806905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:52.817270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-768fc7e0-4d21-4ba0-b8a1-97fc7f7685ef tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.128459 Sep 01 08:21:52.818301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 746/1507] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:52 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:52.854777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:52.860322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:52.860772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:52.868338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:52.869957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:52.871198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cac78190-1f97-4b2f-9957-43d6f7b332ce tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.130944 Sep 01 08:21:52.871771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 762/1508] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:52 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:52.872069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.873027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.873793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.875089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.875907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.876628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.917215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:52.918404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:52.929375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.930114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.930600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.931864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:52.933564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:52.934138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:52.961033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:52.972439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-381a6af3-46f1-4f60-a2bd-7fc112c7a1fb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.121790 Sep 01 08:21:52.973494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 747/1509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:52 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:53.007812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:53.016102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd11c733-5841-4a02-a803-67a0faf484d8 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.107205 Sep 01 08:21:53.016596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 763/1510] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:52 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:53.021854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:53.022816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:53.023029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:53.023555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:53.030560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.030858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.031046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.031404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.031615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.032157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.032331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.032634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.033067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.034064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.034663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.035187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.158153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:53.161644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:53.166847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd455d41-75cb-418e-92c3-b55b011337a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.147442 Sep 01 08:21:53.167536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 764/1511] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:53 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:53.172580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-590901bb-5451-4a91-a503-3f61c537e8b9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.154434 Sep 01 08:21:53.173605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 748/1512] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:53 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:53.847262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:53.847903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:53.854427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.854925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.855363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.856184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.856642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.857328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.895834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:53.896531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:53.903069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.903562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.903996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.905270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:53.905719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:53.906142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:53.936508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:53.950049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e81abb47-8191-4f4c-bd46-f67e8e8e781d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.106450 Sep 01 08:21:53.950787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 765/1513] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:53 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:53.983312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:53.994785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:53.995488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:53.997991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:54.000183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:54.002210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2dbaf154-9dee-4823-aa30-4301e761b673 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.110038 Sep 01 08:21:54.003190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 749/1514] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:53 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:54.003428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.004539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.005287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.006799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.007610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.008593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.050696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:54.051784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:54.063609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.064471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.065242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.066602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.067450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.068203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.089429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:54.100507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-164ec198-514a-47c8-b93f-7e51fa34bcb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.109361 Sep 01 08:21:54.101005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 766/1515] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:53 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:54.159666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:54.171794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c615449b-ae2a-4eae-8354-b8986d292c75 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.126126 Sep 01 08:21:54.172804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 750/1516] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:54 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:54.199537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:54.200169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:54.207349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:54.208220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:54.209596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.210536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.211340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.212884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.213685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.214451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.217281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.217929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.218496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.219315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.219830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.220284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.328628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:54.328918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:54.336987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd4fd271-d2cf-4118-91d0-2fbe62c0227f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.134181 Sep 01 08:21:54.337578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 751/1517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:54 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:54.344064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee09809f-de39-4284-8e97-19037d7a1e84 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.148090 Sep 01 08:21:54.345080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 767/1518] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:54 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:54.973513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:54.974226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:54.986508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.987299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.988022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:54.989210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:54.989971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:54.990719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.039599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:55.040282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:55.048493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.049155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.050498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.053480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.053480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.053480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.077700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.086193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ebd05f44-6dfe-43cf-b4d5-8de5afeee01c tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.117429 Sep 01 08:21:55.098287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 752/1519] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:54 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:55.125216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:55.125893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:55.126626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.133470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.133978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.134488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.135133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.135404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.135581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.136008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.136949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.138073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f146eea6-e5d8-4dd2-9aaa-3bedf0510006 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.102595 Sep 01 08:21:55.139577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 768/1520] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:55 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:55.204913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:55.205430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:55.212476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.213228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.213378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.213660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.214404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.214854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.215276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.222349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3c86e495-e4eb-464b-8559-ef53fb9f5cd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.105168 Sep 01 08:21:55.222928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 753/1521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:55 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:55.282089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.296921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d2ec17e7-dd8f-4137-a44d-07a507b3728f tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.095402 Sep 01 08:21:55.297970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 769/1522] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:55 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:55.371419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:55.372038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:55.372236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:55.373423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:55.378649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.379129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.379565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.380281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.380733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.381163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.384658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.385483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.386235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.387510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:55.388295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:55.389046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:55.397916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:55.456519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.465638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ff39d50-3cc5-4855-8bb4-29c0baa6266d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097491 Sep 01 08:21:55.472346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 770/1523] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:55 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:55.498053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:55.506716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2c09fd94-d1dc-4149-b38e-86d618a4225e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.142681 Sep 01 08:21:55.507422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 754/1524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:55 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:56.113377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:56.114786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:56.125787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.126715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.127479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.128720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.129541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.130310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.163129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:56.164088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:56.172490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.173334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.174032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.175237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.175866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.176339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.236554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.250886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d646d505-3a37-4847-88ea-fc732fc5b4b9 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.145088 Sep 01 08:21:56.251984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 771/1525] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:56 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:56.261282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:56.264872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.270234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:56.280181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.281652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.281834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.282553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.283024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e71747b6-dd7b-463a-9888-6821c8fbe203 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.124097 Sep 01 08:21:56.283389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.283937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 755/1526] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:56 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:56.284814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.285656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.286597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.321462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:56.322179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:56.330701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.331546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.332311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.333530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.334377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.335111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.379483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.393177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-232ac45f-4cca-4e8a-8aa4-e6acb73eae97 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.139344 Sep 01 08:21:56.396886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 772/1527] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:56 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:56.425237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.433374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed9d26c4-c1c9-407a-b640-046f2b87ef55 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.116018 Sep 01 08:21:56.433950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 756/1528] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:56 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:56.490594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:56.491378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:56.501263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.501795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.502286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.503031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.503467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.503884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.532062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:56.533172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:56.543244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.544017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.545227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.546007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:56.546649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:56.547212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:56.586674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.596935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9bd0081b-501a-42ea-abd2-fe7fc7af1c9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.110307 Sep 01 08:21:56.597552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 773/1529] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:56 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:56.629764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:56.638020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fa208890-72ff-47ef-9f54-e8e5680f123b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.112528 Sep 01 08:21:56.640407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 757/1530] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:56 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:57.283163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:57.283792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:57.290305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.290798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.291222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.291928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.292380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.292802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.306871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:57.307540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:57.313408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:57.314548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.315159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.315467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.316297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.316756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.317175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.374675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.384456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-888773ca-247d-4ca6-a094-a3ba50b1c355 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.105052 Sep 01 08:21:57.385209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 774/1531] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:57 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:57.401851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.411356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.413048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.414348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cc4544fe-d715-4081-99b7-45c2e456491a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.111290 Sep 01 08:21:57.414990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 758/1532] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:57 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:21:57.424622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:57.425233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:57.431869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.432349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.432781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.433504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.433947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.434396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.459445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:57.460227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:57.469890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.470691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.471353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.472428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.473136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.473713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.525478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.535407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-af96cc97-72cb-47b0-83eb-194c5c69922e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.114578 Sep 01 08:21:57.535988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 775/1533] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:57 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:57.543200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.557950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d7cbfbf-b4a7-49e5-80a7-e60a373c97b0 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.102782 Sep 01 08:21:57.559021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 759/1534] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:57 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:57.628698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:57.629337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:57.635741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.636225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.636653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.637355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.637798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.638210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.664561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:57.665894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:57.673909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.674436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.674872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.675568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:57.676015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:57.676436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:57.726570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.735529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75ddbb9d-6b38-4f58-8bd0-da04365ba52a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.110869 Sep 01 08:21:57.736113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 776/1535] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:57 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:57.751085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:57.759420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24e45b14-34ae-460d-aea9-b2440f884b3d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.101300 Sep 01 08:21:57.760016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 760/1536] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:57 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:58.409843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:58.410573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:58.417657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.418135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.418674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.419505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.420663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.421258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.445573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:58.446625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:58.458464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.459272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.460048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.461316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.462141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.463174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.491537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.499587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf5efcc4-56d2-411a-b233-0b0126325edd tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093715 Sep 01 08:21:58.500163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 777/1537] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:58 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:58.551041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.557193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:58.557818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:58.559688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.559917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:58.561413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.562594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-911ea0bd-7e68-4be6-9dc3-a55979b63542 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.124846 Sep 01 08:21:58.563158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 761/1538] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:58 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:58.566241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.566749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.567178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.567887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.568330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.568748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.589479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:58.590089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:58.597279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.597752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.598176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.598901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.599345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.599759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.645532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.654027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca132200-bef2-4918-8f2d-dcc0cc79de60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.100630 Sep 01 08:21:58.654741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 778/1539] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:58 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:58.667105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.676518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-36e7320d-7791-44b6-8851-b9e17d62d266 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.091211 Sep 01 08:21:58.677010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 762/1540] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:58 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:58.767723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:58.768339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:58.774705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.775194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.775629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.776337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.776795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.777216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.785480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:58.786608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:58.798030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.798882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.799626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.800872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:58.801693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:58.802760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:58.845090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.860363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c058cbd-c81e-45bb-8c33-78154bcc1206 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096213 Sep 01 08:21:58.861415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 779/1541] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:58 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:58.899986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:58.909266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48bcb9e6-9ccd-4b7a-9be7-452ba9354b96 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.130868 Sep 01 08:21:58.910001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 763/1542] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:58 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:59.534792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:59.535456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:59.545905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.546784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.547512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.548690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.549491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.550280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.598175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:59.598851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:59.600784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:59.607045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.607999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.608780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.609844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.610529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.611093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.638399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:59.647646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c866711e-2868-4048-a318-cbc1dda0606f tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.120174 Sep 01 08:21:59.648216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 780/1543] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:59 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:59.676226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:59.676834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:59.683053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.683541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.683973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.684673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.685644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.686076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.687548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:59.696415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:59.698017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:59.699151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-06bc72c4-b32c-4661-9f8d-e8819b9d42a6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.104962 Sep 01 08:21:59.699706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 764/1544] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:21:59 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:21:59.705143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:59.706809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:59.713506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.713506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.713973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.714591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.715036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.715762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.764522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:59.772307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-373144bb-0590-4710-b087-23d1f0c17b14 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.099799 Sep 01 08:21:59.772914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 781/1545] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:59 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:21:59.789412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:59.798215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4b31ef63-92da-45c8-9400-38558cae8b36 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.097484 Sep 01 08:21:59.798815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 765/1546] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:59 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:21:59.882743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:59.883608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:59.891205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.891691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.892124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.892846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.893293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.893715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.930403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:21:59.931025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:21:59.938435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.938915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.939565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.940321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:21:59.940766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:21:59.941184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:21:59.962066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:21:59.971171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e3d19033-b86e-4426-9ff0-86284616c5c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.092504 Sep 01 08:21:59.971768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 782/1547] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:59 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:00.017462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:00.025956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a6d4b35-d000-498b-9b56-a962b1432f60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.099391 Sep 01 08:22:00.026591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 766/1548] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:21:59 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:00.669935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:00.670673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:00.677552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.678032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.678498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.679204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.679653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.680072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.725154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:00.725931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:00.733021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.733509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.733966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.734824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.735253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.735675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.750401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:00.758546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9755daf-12df-4ad5-8ca3-f3b935b5f6fe tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.092765 Sep 01 08:22:00.759420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 783/1549] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:00 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:00.793455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:00.794064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:00.802591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.803079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.803511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.804223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.804679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.805099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.829056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:00.838600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:00.840192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:00.841539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0b90de0-2ec7-402c-a676-2a135693afcf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.120281 Sep 01 08:22:00.846859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 767/1550] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:00 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:22:00.847735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:00.848421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:00.855674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.856400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.857147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.857976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:00.858616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:00.859184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:00.883518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:00.892305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17b33351-70d9-4d31-b33e-d464f91e097d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.102718 Sep 01 08:22:00.892885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 784/1551] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:00 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:00.923327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:00.931100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4113c295-e0b3-43c5-b9a3-89af5e747e19 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087120 Sep 01 08:22:00.931672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 768/1552] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:00 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:00.999683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:01.000292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:01.006574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.007115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.007584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.008390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.008891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.009472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.048683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:01.049459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:01.058296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.059832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.060603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.061856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.062741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.063459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.089653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:01.099823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ad5c50fa-3585-4071-a070-f4628ad2ee22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.104197 Sep 01 08:22:01.100556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 785/1553] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:00 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:01.154452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:01.162803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-27238f19-7abb-4b40-8c21-46d53d8e118e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.118420 Sep 01 08:22:01.163395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 769/1554] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:01 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:01.780062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:01.780727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:01.787557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.788106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.788663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.789407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.789953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.790535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.861801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:01.870145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e66f11a-4725-41e3-a618-33860c40966d tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093944 Sep 01 08:22:01.870749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 786/1555] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:01 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:01.876201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:01.877241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:01.885508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.886116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.886582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.887298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.887886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.889270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.916849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:01.918056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:01.928921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.929790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.930434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.931441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.932142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.932897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.962364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:01.966530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:01.972746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:01.974196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:01.975340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62d537dd-eaae-4d61-a945-737d8b2abd57 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.105064 Sep 01 08:22:01.975910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 770/1556] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:01 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:01.990289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:01.990927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:01.997164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.998191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:01.998687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:01.999398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:01.999879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:02.000309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:02.025156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:02.038777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d53772f1-b38c-492e-a81b-72c3df566bb8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.128010 Sep 01 08:22:02.039530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 787/1557] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:01 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:02.064945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:02.081907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a787749e-e394-4931-b315-861b4fa40faa tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.104774 Sep 01 08:22:02.082937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 771/1558] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:01 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:02.131813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:02.132419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:02.139139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:02.139619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:02.140045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:02.140743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:02.141184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:02.141609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:02.184858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:02.185529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:02.191808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:02.192282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:02.192760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:02.193497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:02.193940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:02.194384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:02.213262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:02.222988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c718d8d-9afa-41b9-aa06-72786f933a7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.094863 Sep 01 08:22:02.223554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 788/1559] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:02 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:02.259691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:02.268258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-08feddac-e5e2-446a-b318-24189729f0a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087447 Sep 01 08:22:02.269030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 772/1560] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:02 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:02.894327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:02.895028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:02.901544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:02.902021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:02.902478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:02.903180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:02.903623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:02.904034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:02.968210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:02.976231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-91f38e2c-f3fc-46c1-a708-0c04961cae8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086876 Sep 01 08:22:02.976813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 789/1561] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:02 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:02.999169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:02.999797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:03.006012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.006533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.006969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.007663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.008112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.008733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.062049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:03.062728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:03.069002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.069484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.069916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.070649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.071277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.071502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.072591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:03.081735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:03.083188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:03.084300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0fca9fba-927e-46eb-adfb-4e919ece6851 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089880 Sep 01 08:22:03.084856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 773/1562] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:02 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:03.103387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:03.104120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:03.111331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.111781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.112210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.113090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.113532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.114113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.138524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:03.146442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f2c47d2-d16c-48a3-8c44-df374da0bf73 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.089117 Sep 01 08:22:03.146926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 790/1563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:03 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:03.178725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:03.187071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a4d832b5-3de9-418d-b248-4b62d65c6523 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.087854 Sep 01 08:22:03.187640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 774/1564] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:03 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:03.247581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:03.248951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:03.255090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.255570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.255993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.256679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.257120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.257532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.261589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:03.297837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:03.298501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:03.304804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.305285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.305726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.306450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:03.306905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:03.307360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:03.321918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:03.329912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c9e696e7-e15e-4d7f-9b9b-9d7a8ae5645b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.088794 Sep 01 08:22:03.330511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 791/1565] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:03 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:03.371998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:03.381739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b6387471-b608-4a78-a8ae-d35339709d7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088524 Sep 01 08:22:03.382328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 775/1566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:03 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:03.997331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:03.998136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:04.004391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.004875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.005311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.006001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.006478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.006904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.074408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.082710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d03f94e-459a-45a7-b836-7d2404b625b2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089064 Sep 01 08:22:04.083289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 792/1567] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:03 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:04.108640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:04.109259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:04.115615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.116101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.116529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.117230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.117670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.118091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.167530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:04.168197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:04.174869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.175347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.175776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.176462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.176901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.177317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.180811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.189606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.191067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.192177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e46188a-1dd3-4b3f-93c3-79382190d6d6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.088327 Sep 01 08:22:04.193170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 776/1568] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:04 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:04.207408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:04.208015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:04.214461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.214944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.215379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.216068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.217063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.217482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.247132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.255136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0815867c-4bb0-44a8-825c-c969003813b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.091401 Sep 01 08:22:04.255824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 793/1569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:04 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:04.281950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.289678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e7384a07-ef47-4de9-93c6-fe701e6f1889 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.086061 Sep 01 08:22:04.290244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 777/1570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:04 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:04.351266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:04.351863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:04.358408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.358905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.359331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.360019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.360458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.360871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.402585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:04.403203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:04.409237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.409718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.410146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.410869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:04.411315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:04.411732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:04.424646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.432240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee898ac6-57ec-42a1-bfb3-431e02ed30d6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.084787 Sep 01 08:22:04.432805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 794/1571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:04 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:04.475111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:04.483467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-464e9608-446e-4cfc-a6b6-dec4e822c2d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084706 Sep 01 08:22:04.484042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 778/1572] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:04 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:05.105242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:05.105840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:05.112174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.112646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.113106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.113782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.114228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.114660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.181410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.190087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9bf22da-a755-4518-8f9c-8514e7f07d1b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.088997 Sep 01 08:22:05.190709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 795/1573] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:05 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:05.215427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:05.216069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:05.222374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.222852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.223275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.223958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.224398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.224807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.280343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:05.281582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:05.292437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.293353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.294204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.295954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.296746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.297477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.300100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.308446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.309887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.311991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bbbcd9aa-32e1-4043-9209-bed0c10d92b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.100863 Sep 01 08:22:05.326292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 779/1574] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:05 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:05.326292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:05.326292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:05.326292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.326849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.326849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.326849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.326849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.327235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.384624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.395854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-da176360-fbbe-4093-8143-9fb78588d010 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.122613 Sep 01 08:22:05.396446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 796/1575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:05 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:05.405611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.414584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80280766-ad0e-4d47-ab41-ccaa839e9e71 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.100369 Sep 01 08:22:05.415222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 780/1576] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:05 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:05.454147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:05.454886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:05.461072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.461550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.461981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.462961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.463410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.463831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.503756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:05.504363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:05.510578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.511064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.511499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.512250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:05.512726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:05.513217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:05.537389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.549956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-08cbe8c9-c358-4f43-8ee1-ed3506a7da12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.099483 Sep 01 08:22:05.550983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 797/1577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:05 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:05.575122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:05.583156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5633826c-2dc6-49a5-9853-aa8ae761d330 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083021 Sep 01 08:22:05.583737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 781/1578] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:05 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:06.211731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:06.212594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:06.219788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.220269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.220704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.221400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.221843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.222342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.292580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.301233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-986d845a-83a8-4b92-9f26-0ad712923e8b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.093038 Sep 01 08:22:06.301638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 798/1579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:06 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:06.343096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:06.343901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:06.349836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.350355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.350790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.351484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.351930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.352346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.417097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.420515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:06.421555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:06.426695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.428354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.428993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.429533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.429791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f022241-dd20-4760-94b4-9d1fcc527e7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091084 Sep 01 08:22:06.429956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.430641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 782/1580] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:06 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:06.431885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.432551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.433171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.437280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:06.438029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:06.448634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.448634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.448634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.448634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.449289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.449289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.533460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.535616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.544045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1ef41a73-dfda-42b2-ae4c-b5ab1f7682b5 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.111197 Sep 01 08:22:06.544688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 783/1581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:06 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:06.544904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3ad99aec-f64f-4f43-8534-e3559773bd81 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.131604 Sep 01 08:22:06.545322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 799/1582] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:06 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:06.579186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:06.579790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:06.586077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.586578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.587003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.588016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.588570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.589099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.604207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:06.604811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:06.611731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.612218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.612645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.613372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:06.613821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:06.614240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:06.663321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.672546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cc31d1e2-3521-4639-806b-9691cfcddf27 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.097874 Sep 01 08:22:06.673042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 784/1583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:06 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:06.684393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:06.692155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18258792-8542-4705-9402-eedab945821e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.091919 Sep 01 08:22:06.692723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 800/1584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:06 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:07.322768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:07.323375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:07.329643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.330109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.330563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.331255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.331705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.332125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.395445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.403330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24b6a802-1ce0-405c-a4e2-c1e91f2d2ab2 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084345 Sep 01 08:22:07.403983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 785/1585] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:07 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:07.453978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:07.454640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:07.461310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.461793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.462221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.463200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.463641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.464050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.535307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.544751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.546791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.548228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0e5af5cf-44aa-454f-80fd-ae13a66f42e5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.098999 Sep 01 08:22:07.548798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 801/1586] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:07 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:07.565901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:07.566584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:07.568896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:07.569573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:07.573014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.573418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.573845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.574586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.575034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.576018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.576536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.580032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.580943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.582047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.582971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.583395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.655615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.663896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-928b8678-b94a-469d-adca-39f7839846e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.102888 Sep 01 08:22:07.664481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 802/1587] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:07 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:07.673914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.681683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9d83b27b-b648-404b-a7b2-eb3b0cc7a013 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.117114 Sep 01 08:22:07.682248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 786/1588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:07 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:07.693236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:07.693845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:07.699841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.700323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.701296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.701993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.702479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.702898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.713255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:07.713849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:07.721205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.721677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.722107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.722834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:07.723276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:07.723690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:07.743254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:07.768848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.776985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4f856583-adcb-4e74-a4ca-25fbcbcba921 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.087252 Sep 01 08:22:07.777298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 803/1589] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:07 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:07.795294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:07.803282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-55af181a-9152-4c28-8dc3-18e31a5286fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094183 Sep 01 08:22:07.803873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 787/1590] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:07 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:08.424474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:08.424992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:08.431198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.431680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.432106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.432795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.433241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.433660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.497203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:08.505497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-161f17c8-c04c-45a9-a55b-011d58b6b8f8 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.084933 Sep 01 08:22:08.506050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 804/1591] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:08 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:08.571496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:08.572816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:08.579689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.580178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.580613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.581313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.581799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.582222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.675194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:08.684990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:08.685373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:08.685985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:08.686492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:08.687617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c6a3c439-6ecf-4648-bf3a-64436fede99c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.120283 Sep 01 08:22:08.688180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 788/1592] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:08 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:08.692822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.693305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.693744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.694479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.694926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.695342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.703448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:08.704759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:08.714300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.714798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.715719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.715941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.716924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.717346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.868705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:08.877348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd27578a-87f2-4f62-a803-2dea2cd703d0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.195863 Sep 01 08:22:08.878167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 805/1593] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:08 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:08.883424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:08.884021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:08.890932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.891407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.892003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.892519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.892958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.893377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.897333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:08.906365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-97a5bd12-811c-46d4-9deb-ee626b5f349a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.207874 Sep 01 08:22:08.907113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 789/1594] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:08 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:08.911875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:08.912563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:08.919131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.919630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.920049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.920786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:08.921283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:08.921704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:08.960650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:08.969068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0923a84-4ffe-4102-9840-49646fe77713 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.090100 Sep 01 08:22:08.969873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 806/1595] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:08 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:08.998905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:09.007273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cd7c8f33-6d8e-47b6-b612-d5ff1119c4d0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.099123 Sep 01 08:22:09.007837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 790/1596] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:08 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:09.528943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:09.529603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:09.537125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.537679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.538149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.538991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.539435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.539987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.607215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:09.611963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:09.618094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-737fe175-e8de-42e6-a778-c4260172338e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.094726 Sep 01 08:22:09.618898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 807/1597] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:09 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:09.711022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:09.711686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:09.718794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.719273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.719702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.720397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.720838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.721251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.788120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:09.802300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:09.805042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:09.807169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f14c6777-3123-44a0-bf61-fe4cadaf9539 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.099710 Sep 01 08:22:09.808503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 791/1598] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:09 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:09.898932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:09.899513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:09.906717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.907190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.907616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.908301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.908742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.909156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.926925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:09.927534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:09.934621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.934621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.935396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.935807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:09.936256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:09.936669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:09.973708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:09.981464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93aeacb6-c3d0-4cea-aded-fadad1d1e1f0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086298 Sep 01 08:22:09.982342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 808/1599] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:09 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:09.995717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:09.996327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:10.002719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.003268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.003655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:10.003782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.004523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.004972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.005387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.011942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-88d4bceb-1c24-4f29-8437-cbc145521b2a tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.088768 Sep 01 08:22:10.012515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 792/1600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:09 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:10.032315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:10.032929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:10.045670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.046084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.046532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.047235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.047715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.048132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.072495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:10.081647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-721b1161-86ff-4d47-a712-32546ceccc37 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089567 Sep 01 08:22:10.082414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 809/1601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:09 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:10.115384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:10.124083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a02d1ab4-e7e3-4d9d-9014-1325e16ae48e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.096907 Sep 01 08:22:10.124660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 793/1602] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:10 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:10.640727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:10.641753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:10.649166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.649645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.650073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.650797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.651253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.651674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.714313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:10.722361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33d84a0c-b1ab-4f3d-ac88-89946fd2463b tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.086432 Sep 01 08:22:10.722989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 810/1603] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:10 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:10.829951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:10.830569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:10.836772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.837514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.837944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.838651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:10.839093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:10.839503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:10.904343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:10.913834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:10.915287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:10.916388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fc7383b4-e838-474a-afaa-5b3f38348e22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.091103 Sep 01 08:22:10.916951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 794/1604] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:10 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:11.004612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:11.005138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:11.011241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.011709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.012130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.012858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.013928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.014364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.033191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:11.033821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:11.039830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.040304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.040733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.041417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.041853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.042317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.089751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:11.098083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ad5bf48-c63c-4e00-a080-4905acbef0df tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.097624 Sep 01 08:22:11.099309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 811/1605] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:10 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:11.103755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:11.104407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:11.110565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.111044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.111642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.112346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.112784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.113202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.118753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:11.127516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-97b2ce4d-1a23-4b97-98c0-22a9534c98f9 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.098151 Sep 01 08:22:11.129982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 795/1606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:11 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:11.145894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:11.146649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:11.153150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.154438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.154918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.155867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.156386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.156803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.183249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:11.196532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2113e1ae-1087-402a-99fb-eb698ecf385a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.096381 Sep 01 08:22:11.198302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 812/1607] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:11 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:11.235931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:11.249108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2c709e9-cac0-4acb-92ce-27d5215bbce8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.107155 Sep 01 08:22:11.249683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 796/1608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:11 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:11.744976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:11.745605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:11.752579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.753060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.753486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.754179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.754651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.755060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.820887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:11.829813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-73d23a88-723f-45e3-ab30-32a092e6ea0a tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.089598 Sep 01 08:22:11.830418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 813/1609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:11 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:11.939719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:11.940327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:11.946624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.947105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.947536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:11.948217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:11.948662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:11.949075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.016746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.024998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.026447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.027559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6bd97855-e9b0-4d30-8b24-927185488bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.092626 Sep 01 08:22:12.028145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 797/1610] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:11 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:12.119055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:12.119652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:12.128246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.128725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.129153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.129849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.130318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.130738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.148953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:12.149575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:12.155955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.156441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.156873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.157561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.158002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.158454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.202648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.211629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-34b312e9-3e02-4514-bc60-62f89606efe2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.096365 Sep 01 08:22:12.218990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 814/1611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:12 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:12.224227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:12.224843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:12.229868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.238209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.238209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.238209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.238209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.238682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.238682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.239038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-88b7bdb4-c05b-4086-8fb4-17b01f5bf90c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.094145 Sep 01 08:22:12.239620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 798/1612] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:12 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:12.269392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:12.270075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:12.277328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.277923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.278495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.279653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.280443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.281193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.298468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.306742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ac6ed70-c842-4637-9c00-f6877738194c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.086165 Sep 01 08:22:12.307316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 815/1613] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:12 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:12.373420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.381156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ee65563-a19c-45e8-a85a-46dcbd1c0fe3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.115623 Sep 01 08:22:12.381718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 799/1614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:12 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:12.864917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:12.865505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:12.871489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.871963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.872447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.873198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.873639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.874053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.936316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d55971cbce4c61a81b158aa666e2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:12.944173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-42e593ac-5d18-4ca2-bbc4-015dc772b563 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 200 len: 1219 microversion: 2.1 time: 0.083070 Sep 01 08:22:12.944748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 816/1615] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:12 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:12.967415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:12.968032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:12.973987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.974504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.974935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:12.975627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:12.976078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:12.976494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.003254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:22:13.013281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.013755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.014176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.051360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:13.051971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:13.058211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.058731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.059171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.059374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lazy-loading 'flavor' on Instance uuid c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:13.060466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.061234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.061756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.112147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lazy-loading 'system_metadata' on Instance uuid c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:13.126226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:13.134634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:13.136065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:13.137170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b09cf46-8568-4e0c-b267-681962039284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.089830 Sep 01 08:22:13.139129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 817/1616] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:13 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:13.165017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lazy-loading 'metadata' on Instance uuid c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:13.232483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:13.233252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:13.239805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.240286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.240719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.241427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.241877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.242317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.314340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:13.323116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=8 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:13.324713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6480e89d-2d5b-4020-a887-5977f82ff680 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.096021 Sep 01 08:22:13.338468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 818/1617] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:13 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:13.345268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:13.345948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:13.354540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.355028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.355458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.356150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.356643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.357060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.428566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:13.442149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ab13104-a4ea-4b92-b382-7bac88545161 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.102462 Sep 01 08:22:13.444004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 819/1618] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:13 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:13.447860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:13.448692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:13.456859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.457510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.458085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.459061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.459655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.460523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.539808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:13.548967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f799299a-3a57-46fd-8ebe-5da032eb8422 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.105103 Sep 01 08:22:13.562109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 820/1619] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:13 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:13.562109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:13.562109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:13.562109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.562718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.563221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.564032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.564449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.564872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.570181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Deleted allocations for instance c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 Sep 01 08:22:13.593646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ca347e9-1a18-42de-9292-33cbd7499b5e tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 204 len: 0 microversion: 2.1 time: 0.631227 Sep 01 08:22:13.594484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 800/1620] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:22:12 2022] DELETE /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:22:13.603242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:13.603945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] [instance: c70cf1f4-b55c-4076-a7b8-4afbfdb6f104] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:13.610867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.611376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.611789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.612490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:13.612942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:13.613361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:13.628218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] HTTP exception thrown: Instance c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 could not be found. Sep 01 08:22:13.629952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Request method failure captured: Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 HTTP/1.1 Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGpEih5QbspT21RkUVIqU2_DGEa3t9Eop-jJTQMB170dbnNmX8oAdv6uktvV-HLE99gCOgxhseMVbM7OyXOCiynnfPbIPTckLML69mq-axExwRBOXFZq8Y8_CtfPZDt7KXzve81Gx-QltzpRjOAJdJOOpkTJoyWtuXp3XsO5tVBUmo4 Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: e17cd7e07aa94984a3ecdb3fbce1b097 Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-DeleteServersTestJSON-376792496 Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:22:13.632815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e17cd7e07aa94984a3ecdb3fbce1b097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e17cd7e07aa94984a3ecdb3fbce1b097"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e17cd7e07aa94984a3ecdb3fbce1b097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e17cd7e07aa94984a3ecdb3fbce1b097"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-DeleteServersTestJSON-376792496 Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: e17cd7e07aa94984a3ecdb3fbce1b097 Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-DeleteServersTestJSON-376792496 Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-DeleteServersTestJSON-376792496-project Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: c5d55971cbce4c61a81b158aa666e2ea Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-DeleteServersTestJSON-376792496-project Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 could not be found. Sep 01 08:22:13.634341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': 'c70cf1f4-b55c-4076-a7b8-4afbfdb6f104'} Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 could not be found. Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:22:13.635381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 could not be found. Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 could not be found. Sep 01 08:22:13.636835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:22:13.638686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] Returning 404 to user: Instance c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:22:13.638686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b821d8df-fbc3-407b-90ac-f63cdf941405 tempest-DeleteServersTestJSON-376792496 tempest-DeleteServersTestJSON-376792496-project] 10.222.0.43 "GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104" status: 404 len: 111 microversion: 2.1 time: 0.035371 Sep 01 08:22:13.638686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 801/1621] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:13 2022] GET /compute/v2.1/servers/c70cf1f4-b55c-4076-a7b8-4afbfdb6f104 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 08:22:13.638971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-613771eb-d868-48f3-88d1-c45a4f4de0bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088251 Sep 01 08:22:13.639765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 821/1622] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:13 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:14.175595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:14.176209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:14.182409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.182888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.183315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.184021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.184440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.185765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.253029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:14.261452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:14.262986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:14.264225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-12e2bd98-ad22-486f-8c68-9e2e8eac7c4d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.093064 Sep 01 08:22:14.264783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 802/1623] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:14 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:14.348883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:14.349676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:14.355823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.356373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.357562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.358282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.358737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.359156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.422060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:14.430124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8532d683-bfe3-4a12-941c-ed9eca35319a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084966 Sep 01 08:22:14.430949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 822/1624] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:14 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:14.464331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:14.466712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:14.471530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.472159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.472414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.473115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.473553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.473966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.536979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:14.545707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-773707a0-cf9c-4982-89df-99457018aceb tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.085318 Sep 01 08:22:14.546359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 803/1625] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:14 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:14.573703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:14.574539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:14.581184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.581733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.582281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.583063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.583696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.584362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.660843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:14.661465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:14.662088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:14.669696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.670197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.670687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.671400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:14.671853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:14.672278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:14.673939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-91ee1270-2d75-4125-a5e2-7d4829556ed8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.105167 Sep 01 08:22:14.674829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 823/1626] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:14 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:14.747585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:14.756668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-96147b90-faff-4063-aa7f-8cff87dabe7c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.100146 Sep 01 08:22:14.757476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 804/1627] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:14 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:15.287502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:15.288171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:15.294762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.295253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.295695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.296391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.297217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.297353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.315726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:15.377279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:15.386796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:15.388771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:15.389893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7a530af-ceb8-46e4-af23-a3e38d3d71fa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.106669 Sep 01 08:22:15.390759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 824/1628] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:15 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:15.452300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:15.452906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:15.458799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.459274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.459696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.460378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.460819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.461229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.523167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:15.530896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f16b083f-962a-4de1-bf43-ce61420245d9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083087 Sep 01 08:22:15.531475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 805/1629] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:15 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:15.565648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:15.566169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:15.576289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.576289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.576289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.576554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.576932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.577453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.645299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:15.653293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7da0616-a835-4523-8ab1-4e4ab0e3fee7 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.091603 Sep 01 08:22:15.654073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 825/1630] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:15 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:15.694854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:15.695664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:15.702670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.703228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.703754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.704527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.705043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.705529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.771969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:15.781469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d48df625-975e-4ff3-9aa7-dc8979b0e5ff tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.089830 Sep 01 08:22:15.789605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 806/1631] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:15 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:15.791873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:15.792667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:15.800149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.800636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.801648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.801971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:15.802455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:15.802880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:15.875322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:15.884909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a11df8a7-5ec4-4363-a150-f2652aac8f42 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.109603 Sep 01 08:22:15.886128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 826/1632] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:15 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:16.413177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:16.413638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:16.420828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.421280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.422071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.423085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.423786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.424347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.535721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:16.544557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:16.546685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:16.548102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3a4459ab-545f-4629-873f-5b732a2057d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.138932 Sep 01 08:22:16.548863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 807/1633] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:16 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:16.555214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:16.555214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:16.567087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.567087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.567087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.567087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.567962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.567962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.657742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:16.665903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f94da4fd-f66f-48ec-9d0c-2b8a8740bb86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.118438 Sep 01 08:22:16.667825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 827/1634] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:16 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:16.672922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:16.673523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:16.680346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.680845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.681289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.681995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.682486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.682919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.749865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e77042ee14f7f806a33f9c9501bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d43ea736fc0496d841b2530242dfde6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:16.759360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91c8e50e-f50e-45bf-98bc-7fd4d8d45328 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 200 len: 1226 microversion: 2.1 time: 0.090144 Sep 01 08:22:16.759911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 808/1635] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:16 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:16.780924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:16.781418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:16.783504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:16.790359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.790903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.791335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.792188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.792788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.794608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.804983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:16.807306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:16.809736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:16.824399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.827877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:22:16.833343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.833343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.833343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.833816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.834458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.870456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:16.870941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:16.871373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:16.985814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lazy-loading 'flavor' on Instance uuid e42cd0f8-f704-43d1-b5ec-267b8310a5b5 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:17.107360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lazy-loading 'system_metadata' on Instance uuid e42cd0f8-f704-43d1-b5ec-267b8310a5b5 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:17.137959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:17.147317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-effe7cf3-eea9-462a-810b-862f50cd33e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.346162 Sep 01 08:22:17.162469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 809/1636] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:16 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:17.167528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:17.168362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:17.177471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.178241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.178895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.179771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.180459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.181036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.241183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lazy-loading 'metadata' on Instance uuid e42cd0f8-f704-43d1-b5ec-267b8310a5b5 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:17.312991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:17.323224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc11e7cb-7f26-4a00-acea-2e51d8cee9e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.158736 Sep 01 08:22:17.323680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 810/1637] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:17 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:17.570600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:17.571494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:17.579658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.580161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.580594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.581795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.582293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.582721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.689383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:17.703043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:17.705747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:17.708033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-59a3659a-de5f-4ba4-a68f-b6afccaa8670 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.141236 Sep 01 08:22:17.709707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 811/1638] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:17 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:22:17.725142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:17.726950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:17.746382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.751546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.752705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.753635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.754325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.754762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.779913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Deleted allocations for instance e42cd0f8-f704-43d1-b5ec-267b8310a5b5 Sep 01 08:22:17.805372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e3089a49-783f-467f-addb-055347995c2e tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 204 len: 0 microversion: 2.1 time: 1.029002 Sep 01 08:22:17.806769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 828/1639] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:22:16 2022] DELETE /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:22:17.819671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:17.820393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: e42cd0f8-f704-43d1-b5ec-267b8310a5b5] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:17.827891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.828302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.828733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.829435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.829877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.830656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.848436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:17.852181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] HTTP exception thrown: Instance e42cd0f8-f704-43d1-b5ec-267b8310a5b5 could not be found. Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Request method failure captured: Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 HTTP/1.1 Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGpDpywuEUvPWerQx-jh1QKXSW4emj9KtBaBTyJDQ_ueNPehpQAyycjdALg49mlkMlubeQ8wLitMz76De-szGFKb2ivlGW7OIAXeaqVKtymRUD0spv3dw9hu3Bk0H8yuOleXdIKFd_PePv3qu22TlodCD9sgEkkPaZ-AhDt4wavWvv8 Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 7d43ea736fc0496d841b2530242dfde6 Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-69421073 Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:22:17.858313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d43ea736fc0496d841b2530242dfde6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d43ea736fc0496d841b2530242dfde6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7d43ea736fc0496d841b2530242dfde6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7d43ea736fc0496d841b2530242dfde6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-69421073 Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 7d43ea736fc0496d841b2530242dfde6 Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-69421073 Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-ServerRescueNegativeTestJSON-69421073-project Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 854e77042ee14f7f806a33f9c9501bb0 Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-69421073-project Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance e42cd0f8-f704-43d1-b5ec-267b8310a5b5 could not be found. Sep 01 08:22:17.861605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': 'e42cd0f8-f704-43d1-b5ec-267b8310a5b5'} Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42cd0f8-f704-43d1-b5ec-267b8310a5b5 could not be found. Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:22:17.863114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42cd0f8-f704-43d1-b5ec-267b8310a5b5 could not be found. Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42cd0f8-f704-43d1-b5ec-267b8310a5b5 could not be found. Sep 01 08:22:17.867545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:17.872778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Returning 404 to user: Instance e42cd0f8-f704-43d1-b5ec-267b8310a5b5 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:22:17.873033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a3fb2f8-cf4b-4658-a4a6-4b7e5fe458c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.149000 Sep 01 08:22:17.873292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0dc3dfd0-4128-4a17-8426-a8e920e14e9d tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5" status: 404 len: 111 microversion: 2.1 time: 0.045790 Sep 01 08:22:17.873292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 829/1640] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:17 2022] GET /compute/v2.1/servers/e42cd0f8-f704-43d1-b5ec-267b8310a5b5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:22:17.876095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 812/1641] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:17 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:17.876802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:17.877878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: c475829b-c46b-4320-984b-1c5368564cf8] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:17.886890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.887798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.888501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.889652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.890482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.891381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.950354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: c475829b-c46b-4320-984b-1c5368564cf8] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:22:17.962946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:17.963555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:17.964545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:17.982490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lazy-loading 'flavor' on Instance uuid c475829b-c46b-4320-984b-1c5368564cf8 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:17.996100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lazy-loading 'system_metadata' on Instance uuid c475829b-c46b-4320-984b-1c5368564cf8 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:18.015506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lazy-loading 'metadata' on Instance uuid c475829b-c46b-4320-984b-1c5368564cf8 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:18.146207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Deleted allocations for instance c475829b-c46b-4320-984b-1c5368564cf8 Sep 01 08:22:18.163702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a1a67c05-2338-4ff2-af87-4a670ead2e02 tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c475829b-c46b-4320-984b-1c5368564cf8" status: 204 len: 0 microversion: 2.1 time: 0.294403 Sep 01 08:22:18.164540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 830/1642] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:22:17 2022] DELETE /compute/v2.1/servers/c475829b-c46b-4320-984b-1c5368564cf8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:22:18.169901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:18.170860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:18.173867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:18.174505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] [instance: c475829b-c46b-4320-984b-1c5368564cf8] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:18.177928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.178693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.179361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.180264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.180936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.181421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.181555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.181920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.182388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.183073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.183515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.183927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.200824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] HTTP exception thrown: Instance c475829b-c46b-4320-984b-1c5368564cf8 could not be found. Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Request method failure captured: Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/c475829b-c46b-4320-984b-1c5368564cf8 HTTP/1.1 Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGpDpywuEUvPWerQx-jh1QKXSW4emj9KtBaBTyJDQ_ueNPehpQAyycjdALg49mlkMlubeQ8wLitMz76De-szGFKb2ivlGW7OIAXeaqVKtymRUD0spv3dw9hu3Bk0H8yuOleXdIKFd_PePv3qu22TlodCD9sgEkkPaZ-AhDt4wavWvv8 Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 7d43ea736fc0496d841b2530242dfde6 Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-69421073 Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:22:18.202395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d43ea736fc0496d841b2530242dfde6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d43ea736fc0496d841b2530242dfde6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7d43ea736fc0496d841b2530242dfde6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7d43ea736fc0496d841b2530242dfde6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-69421073 Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 7d43ea736fc0496d841b2530242dfde6 Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-69421073 Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-ServerRescueNegativeTestJSON-69421073-project Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 854e77042ee14f7f806a33f9c9501bb0 Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-69421073-project Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance c475829b-c46b-4320-984b-1c5368564cf8 could not be found. Sep 01 08:22:18.203699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': 'c475829b-c46b-4320-984b-1c5368564cf8'} Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c475829b-c46b-4320-984b-1c5368564cf8 could not be found. Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:22:18.204432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c475829b-c46b-4320-984b-1c5368564cf8 could not be found. Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c475829b-c46b-4320-984b-1c5368564cf8 could not be found. Sep 01 08:22:18.205596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:18.207026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] Returning 404 to user: Instance c475829b-c46b-4320-984b-1c5368564cf8 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:22:18.207026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65523161-5691-41fd-9a1c-8146c9142d5c tempest-ServerRescueNegativeTestJSON-69421073 tempest-ServerRescueNegativeTestJSON-69421073-project] 10.222.0.43 "GET /compute/v2.1/servers/c475829b-c46b-4320-984b-1c5368564cf8" status: 404 len: 111 microversion: 2.1 time: 0.035569 Sep 01 08:22:18.207026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 831/1643] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:18 2022] GET /compute/v2.1/servers/c475829b-c46b-4320-984b-1c5368564cf8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:22:18.260138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:18.268147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-08f87d8b-89d9-41db-88cb-872b905e10e3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.102415 Sep 01 08:22:18.268832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 813/1644] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:18 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:18.345828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:18.346706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:18.354610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.355475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.356120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.357908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.358561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.359893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.477217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:18.487800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f6125caf-db7a-4b2b-a245-ea4a829c0104 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.147076 Sep 01 08:22:18.488451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 832/1645] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:18 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:18.748675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:18.749385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:18.756114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.756607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.757103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.757808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.758501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.758929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.856093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:18.865464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:18.866945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:18.868035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-638cc0b2-7798-40fa-a136-b0f6edc9cfbd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.123765 Sep 01 08:22:18.868931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 814/1646] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:18 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:18.885129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:18.885733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:18.894241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.894737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.895196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:18.895921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:18.896532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:18.897339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:19.184358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:19.193682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5c42a6f5-5481-48ad-a945-bd6eae665945 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.312073 Sep 01 08:22:19.194351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 833/1647] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:18 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:19.289445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:19.290070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:19.297667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:19.298463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:19.298899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:19.299797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:19.300433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:19.300869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:19.441122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:19.449898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4b9470f5-86ef-4113-a634-e17e3d5cccef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.164148 Sep 01 08:22:19.450685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 815/1648] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:19 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:19.509129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:19.509815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:19.518226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:19.519023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:19.519573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:19.520275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:19.520721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:19.521134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:19.526817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=22,nova_cell1:DELETE=4 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:19.614020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:19.635221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6287e081-0586-4c5f-8967-21a9716aba59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.129593 Sep 01 08:22:19.636596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 834/1649] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:19 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:19.893524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:19.894371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:19.900943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:19.901481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:19.901968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:19.902735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:19.903774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:19.904762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:20.010824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:20.021187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:20.022631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:20.023720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-71a8254b-d751-4578-89c5-f5a0e1f4ce2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.134614 Sep 01 08:22:20.024263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 816/1650] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:19 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:20.215259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:20.215922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:20.229714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:20.230532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:20.231154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:20.232390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:20.232836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:20.233261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:20.364276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:20.373565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b20522df-493f-4b42-9eaf-674d63a5f37f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.161291 Sep 01 08:22:20.378224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 835/1651] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:20 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:20.477265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:20.477874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:20.485938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:20.487019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:20.487460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:20.488163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:20.489325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:20.490495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:20.513149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:DELETE=2,nova_cell1:SELECT=95 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:20.579809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:20.595924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-abdb122d-9fa3-436b-939a-4ec66370587d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.122350 Sep 01 08:22:20.603228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 817/1652] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:20 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:20.662351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:20.663787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:20.675304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:20.676662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:20.678091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:20.679824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:20.680787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:20.681513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:20.993649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:21.008502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-00d4f013-c800-4ddd-95a4-cae8c4bee4cc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.352226 Sep 01 08:22:21.010675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 836/1653] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:20 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:21.051494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:21.052510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:21.061512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.069269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.071108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.072199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.073803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.074301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.267451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:21.279235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:21.280681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:21.281984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d1e80d8-af92-43fd-b20a-9b88060853f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.236548 Sep 01 08:22:21.282564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 818/1654] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:21 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:21.397805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:21.399057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:21.407071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.407684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.408524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.410149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.410768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.412242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.567502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:21.594314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5e7c1b72-5012-464a-b762-c60d19f6df7c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.202652 Sep 01 08:22:21.595536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 837/1655] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:21 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:21.629466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:21.630391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:21.645657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.646146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.646812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.647838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.650798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.651436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.803526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:21.812635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a763ec31-f5db-4377-91bf-40ffa06d6da9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 200 len: 1242 microversion: 2.1 time: 0.188209 Sep 01 08:22:21.826599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 819/1656] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:21 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 1242 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:21.832826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:21.833666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:21.840907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.841822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.842491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.843632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.844106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.844524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.882055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:22:21.894919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:21.895515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:21.896664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:21.925565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lazy-loading 'flavor' on Instance uuid 4ee48a2d-63b7-44b6-832e-abc2c010ea13 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:21.941484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lazy-loading 'system_metadata' on Instance uuid 4ee48a2d-63b7-44b6-832e-abc2c010ea13 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:21.973874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lazy-loading 'metadata' on Instance uuid 4ee48a2d-63b7-44b6-832e-abc2c010ea13 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:22.037384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:22.038077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:22.053318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.055675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.058154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.059166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.065739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.067520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.177765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Deleted allocations for instance 4ee48a2d-63b7-44b6-832e-abc2c010ea13 Sep 01 08:22:22.204087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4392074e-847d-4dbc-98a4-4f546b028c39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 204 len: 0 microversion: 2.1 time: 0.374944 Sep 01 08:22:22.208148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 838/1657] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:22:21 2022] DELETE /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:22:22.216773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:22.220848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 4ee48a2d-63b7-44b6-832e-abc2c010ea13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:22.229281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.230350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.233113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.234163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.234960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.235614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.250077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:22.256408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] HTTP exception thrown: Instance 4ee48a2d-63b7-44b6-832e-abc2c010ea13 could not be found. Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Request method failure captured: Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 HTTP/1.1 Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGpKurIpoyXX1XPjScUxBVPhYWGWYPUuA8zNKx5fWxgkUKBCLNP5rnCHu0KmQpkf99clcZE52xYHX4FtfRk-mLLfy5W7s9J9-7sw_vIcinHvQblLzukzh_yidz45Ny0eXajXFaP0mq299K_XiAn_73ReY6SAdUKBHeEDaoH6kRDdOc8 Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: b2e0d80b70984b39a3a4c07d0018f67b Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-AttachVolumeTestJSON-177408922 Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:22:22.258421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e0d80b70984b39a3a4c07d0018f67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e0d80b70984b39a3a4c07d0018f67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2e0d80b70984b39a3a4c07d0018f67b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2e0d80b70984b39a3a4c07d0018f67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-AttachVolumeTestJSON-177408922 Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: b2e0d80b70984b39a3a4c07d0018f67b Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-177408922 Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-AttachVolumeTestJSON-177408922-project Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: eaf3d36d40d442019e09a3e4c32b8330 Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-AttachVolumeTestJSON-177408922-project Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance 4ee48a2d-63b7-44b6-832e-abc2c010ea13 could not be found. Sep 01 08:22:22.259793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '4ee48a2d-63b7-44b6-832e-abc2c010ea13'} Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee48a2d-63b7-44b6-832e-abc2c010ea13 could not be found. Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:22:22.260557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee48a2d-63b7-44b6-832e-abc2c010ea13 could not be found. Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee48a2d-63b7-44b6-832e-abc2c010ea13 could not be found. Sep 01 08:22:22.261796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:22.263232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-718f26e7-9bba-4eca-bd81-0a224fb7f1de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.231777 Sep 01 08:22:22.264703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 820/1658] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:22 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:22.279978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Returning 404 to user: Instance 4ee48a2d-63b7-44b6-832e-abc2c010ea13 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:22:22.281505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8578a6ff-e57a-4800-8b60-5f72b44b1ca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13" status: 404 len: 111 microversion: 2.1 time: 0.071568 Sep 01 08:22:22.288769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 839/1659] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:22 2022] GET /compute/v2.1/servers/4ee48a2d-63b7-44b6-832e-abc2c010ea13 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:22:22.294522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-78ffed96-d847-4ecc-a7b4-067485efffc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '.version_select at 0x7f2ac29c1c10>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:22.311419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:22.312365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:22.327280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.331230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.333628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.335061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.335687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-78ffed96-d847-4ecc-a7b4-067485efffc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619341742" status: 202 len: 0 microversion: 2.1 time: 0.045803 Sep 01 08:22:22.336270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 821/1660] 10.222.0.43 () {58 vars in 1221 bytes} [Thu Sep 1 08:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619341742 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 08:22:22.337226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.338300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.508226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:22.531331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:22.536579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:22.540549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03011c98-d766-438d-9a76-48f956802ebf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 200 len: 1286 microversion: 2.20 time: 0.236509 Sep 01 08:22:22.543040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 840/1661] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:22 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 1286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:22.565499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:22.566003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:22.576672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.577997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.579079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.582748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.583248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.583691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.617694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:22.618883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:22.631386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.633862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.635433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.636274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.639013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.639553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.648111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:22:22.670769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:22.671329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:22.671857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:22.703307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lazy-loading 'flavor' on Instance uuid 128e4ada-2ce7-4bba-b16c-f54b37463c0d {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:22.739465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lazy-loading 'system_metadata' on Instance uuid 128e4ada-2ce7-4bba-b16c-f54b37463c0d {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:22.772586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lazy-loading 'metadata' on Instance uuid 128e4ada-2ce7-4bba-b16c-f54b37463c0d {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:22:22.813751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:22.828902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-818248f8-1950-4957-98c9-5af00fb527c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.216878 Sep 01 08:22:22.829513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 841/1662] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:22 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:23.003037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Deleted allocations for instance 128e4ada-2ce7-4bba-b16c-f54b37463c0d Sep 01 08:22:23.051528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-83604912-2c25-4cc8-b843-b0efc4d9519f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "DELETE /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 204 len: 0 microversion: 2.20 time: 0.490111 Sep 01 08:22:23.053005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 822/1663] 10.222.0.43 () {60 vars in 1280 bytes} [Thu Sep 1 08:22:22 2022] DELETE /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 08:22:23.068490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:23.072532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 128e4ada-2ce7-4bba-b16c-f54b37463c0d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:23.084805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:23.085333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:23.085779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:23.086532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:23.087255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:23.087684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:23.124283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] HTTP exception thrown: Instance 128e4ada-2ce7-4bba-b16c-f54b37463c0d could not be found. Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Request method failure captured: Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d HTTP/1.1 Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGpN5wB9uS7zrQ96OeXlTYHObcBEvaEn7SObCULdxAm5J4DIkSV3apHXHXJ-buzACnuSMoimhJqbOzBfEphicKKgzDCTBeGYSQmUeakI03qAfxRQKEZzzhycMxOQsG51EHo9hb0c5_ByejPvAL7lTwCPW367wMZ4aDWK9K4m0-MgE3w Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 631e2e8467654c0ea799bf50fed7afad Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064350163 Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:22:23.126472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/631e2e8467654c0ea799bf50fed7afad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/631e2e8467654c0ea799bf50fed7afad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_631e2e8467654c0ea799bf50fed7afad", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/631e2e8467654c0ea799bf50fed7afad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064350163 Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 631e2e8467654c0ea799bf50fed7afad Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064350163 Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-AttachVolumeShelveTestJSON-2064350163-project Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 7559a0b8d46b4524b40f68b992f6cfe9 Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064350163-project Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance 128e4ada-2ce7-4bba-b16c-f54b37463c0d could not be found. Sep 01 08:22:23.128026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '128e4ada-2ce7-4bba-b16c-f54b37463c0d'} Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128e4ada-2ce7-4bba-b16c-f54b37463c0d could not be found. Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:22:23.128808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128e4ada-2ce7-4bba-b16c-f54b37463c0d could not be found. Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128e4ada-2ce7-4bba-b16c-f54b37463c0d could not be found. Sep 01 08:22:23.129994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:23.137169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Returning 404 to user: Instance 128e4ada-2ce7-4bba-b16c-f54b37463c0d could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:22:23.138604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d71d9768-ed1e-4c6e-b7b4-258a6d0daf4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d" status: 404 len: 111 microversion: 2.20 time: 0.075752 Sep 01 08:22:23.139737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 842/1664] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:23 2022] GET /compute/v2.1/servers/128e4ada-2ce7-4bba-b16c-f54b37463c0d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 08:22:23.152059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b94b0ed-35b1-4415-8248-f6d017697815 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '.version_select at 0x7f2ac29ca670>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:23.187710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b94b0ed-35b1-4415-8248-f6d017697815 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734933604" status: 204 len: 0 microversion: 2.20 time: 0.041528 Sep 01 08:22:23.189099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 823/1665] 10.222.0.43 () {60 vars in 1262 bytes} [Thu Sep 1 08:22:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734933604 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 08:22:23.288397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:23.289340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:23.302757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:23.303938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:23.304669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:23.306170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:23.307308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:23.308313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:23.480521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:23.504269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c8ca4f6f-c461-4243-bdf6-36ff787c8305 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.220986 Sep 01 08:22:23.506406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 843/1666] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:23 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:23.851431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:23.852447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:23.861621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:23.863048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:23.863769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:23.864836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:23.865504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:23.866348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:23.985178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:24.004034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19c3442b-ebb7-445e-87bf-8346de93c97b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.156327 Sep 01 08:22:24.014659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 824/1667] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:23 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:24.027028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb168e46-5331-4aa5-9c23-451adc66d87b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Action: 'create', calling method: .version_select at 0x7f2ac29e79d0>, body: {"keypair": {"name": "tempest-keypair-497273491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi2ivsNrjtHR44vW4IesZeVpk9x5b92WOIu/9o3hsUjYzufsIlf48kRLHoW+vVeTJMHkb4pL7TAZJlCbBnh47zL2YPzkpGKYPO6QbEhU9oeQnop0NXGMT56Mxt8C1Cdfw=="}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:22:24.054283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-bb168e46-5331-4aa5-9c23-451adc66d87b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:22:24.064302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-bb168e46-5331-4aa5-9c23-451adc66d87b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for user eaf3d36d40d442019e09a3e4c32b8330 and project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:22:24.102117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb168e46-5331-4aa5-9c23-451adc66d87b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083778 Sep 01 08:22:24.103845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 844/1668] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:22:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:22:24.529741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:24.531374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:24.551621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:24.552600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:24.556858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:24.562302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:24.564413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:24.565725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:24.752642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:24.763678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f9e8072-504e-46f0-83c8-e419ad7fade0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.239012 Sep 01 08:22:24.778947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 825/1669] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:24 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:25.035669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:25.037190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:25.044141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:25.045133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:25.045820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:25.046837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:25.047588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:25.048239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:25.186065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:25.203640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3db48ceb-6d2d-4c76-a126-28cb00dd3f1c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Action: 'create', calling method: .version_select at 0x7f2ac29aac10>, body: {"keypair": {"name": "tempest-keypair-734768784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8/y9TBfUFa/S5FNU0LdODYyUh0B4l4nayjb0ZpLqQYeZUVyjEdgSNw3ErQ01oXsbuFV0ZojYYc5vi7n+POFxCr+LtRh9w48eczvdAybidq6kJv22N2ClV5/CHa+BjTqQ=="}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:22:25.220752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e2f6137a-353f-4a1d-8f24-6f005b4d1134 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.188833 Sep 01 08:22:25.228296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 845/1670] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:25 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:25.256909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-3db48ceb-6d2d-4c76-a126-28cb00dd3f1c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for project 631e2e8467654c0ea799bf50fed7afad. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:22:25.270686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-3db48ceb-6d2d-4c76-a126-28cb00dd3f1c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for user 7559a0b8d46b4524b40f68b992f6cfe9 and project 631e2e8467654c0ea799bf50fed7afad. Resources: {'key_pairs'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:22:25.341643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3db48ceb-6d2d-4c76-a126-28cb00dd3f1c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.143212 Sep 01 08:22:25.343143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 826/1671] 10.222.0.43 () {62 vars in 1200 bytes} [Thu Sep 1 08:22:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 08:22:25.785496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:25.786104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:25.802129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:25.802844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:25.803485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:25.804366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:25.806771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:25.807397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:25.939082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:25.958851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e3119d68-9fda-49dc-b0b6-8cc54b844691 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.175454 Sep 01 08:22:25.960702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 846/1672] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:25 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:26.252655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:26.253447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:26.266028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:26.269090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:26.269692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:26.270552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:26.273984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:26.275357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:26.436798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:26.472755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cdb3b035-c881-499d-8d7a-133169807358 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.221630 Sep 01 08:22:26.473260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 827/1673] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:26 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:26.998756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:27.000029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:27.015408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:27.016303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:27.016943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:27.018149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:27.018947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:27.019539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:27.234517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:27.245154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce96fadc-1863-4584-bf6b-66c2a75eec84 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.251717 Sep 01 08:22:27.246026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 847/1674] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:26 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:27.297143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-752159088", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d30f2003-569b-461f-8960-16f50bc6e4df"}], "security_groups": [{"name": "tempest-securitygroup--797454838"}], "key_name": "tempest-keypair-497273491", "user_data": "}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:22:27.580902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] validate_networks() for [('d30f2003-569b-461f-8960-16f50bc6e4df', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:22:27.688635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bac4a518-a63c-4f08-ad24-4551c273b3f2 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Action: 'create', calling method: .version_select at 0x7f2ac2ab8940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1804495849", "metadata": {"Type": "work"}}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:22:28.106754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bac4a518-a63c-4f08-ad24-4551c273b3f2 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.667292 Sep 01 08:22:28.115626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 848/1675] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Sep 1 08:22:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 677 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 01 08:22:28.120819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:28.122160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:28.128786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:28.129331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:28.130288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:28.130435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:28.131050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:28.131658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:28.300581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:28.314998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b79438b7-a7f7-4c35-b982-0fd1da98c85c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.195015 Sep 01 08:22:28.327413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 849/1676] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:28 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:28.332750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc0a981a-d50a-40ca-9df8-8338f2a72c9e tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Calling method '.version_select at 0x7f2ac29c84c0>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:28.454211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc0a981a-d50a-40ca-9df8-8338f2a72c9e tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765" status: 200 len: 353 microversion: 2.1 time: 0.136844 Sep 01 08:22:28.454975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 850/1677] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:22:28 2022] GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:22:28.462236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:28.462879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:28.470841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:28.471757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:28.477610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:28.478910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:28.479685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:28.480350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:28.486734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:28.596859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:28.606644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a694cd2c-4517-4c8b-81e3-b5fc1b607fce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.148809 Sep 01 08:22:28.623765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 851/1678] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:28 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:28.941667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:22:28.942162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:22:28.942590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:22:28.943031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:22:28.943533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:22:28.954071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:28.954782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:28.955373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:28.956263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:28.956718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:28.957137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:28.975900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:22:28.980274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Getting quotas for user eaf3d36d40d442019e09a3e4c32b8330 and project b2e0d80b70984b39a3a4c07d0018f67b. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:22:28.993008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:22:28.997091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:22:29.081990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd029cb1-aa7b-4e56-b19d-8c61292cf4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.791111 Sep 01 08:22:29.082929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 828/1679] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:22:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:22:29.104595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a4f3c6e-6b94-445b-bfc0-2d774ee4ee3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:29.105667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a4f3c6e-6b94-445b-bfc0-2d774ee4ee3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:29.173589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-97ef15ac-749d-4039-b453-2485f078dbe5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Action: 'create', calling method: .version_select at 0x7f2ac29c8dc0>, body: {"keypair": {"name": "tempest-keypair-1648294146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK95pYs9i4CILnygpKS1sIs7vqKpDDxFar3d0WgeccyJnViazOc75TfX8OOSLv701ppRu5pPRgb1cSrTreCUbc8EIE7X4NMvl0C1VDPPfPvjv3yo9fnuyn8O+9BwnD/UsQ=="}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:22:29.195378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-97ef15ac-749d-4039-b453-2485f078dbe5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:22:29.201169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-97ef15ac-749d-4039-b453-2485f078dbe5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for user ccd2c619e9fc436ea01a1200bc46b60f and project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:22:29.205095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a4f3c6e-6b94-445b-bfc0-2d774ee4ee3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:29.225768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a4f3c6e-6b94-445b-bfc0-2d774ee4ee3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1236 microversion: 2.1 time: 0.126137 Sep 01 08:22:29.225768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 829/1680] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:29 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1236 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:29.245569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-97ef15ac-749d-4039-b453-2485f078dbe5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179056 Sep 01 08:22:29.246311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 852/1681] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:22:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:22:29.259280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-788931381", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65699cbd-f387-4c8e-aac1-9e9e4b156099"}], "security_groups": [{"name": "tempest-securitygroup--1233229853"}], "key_name": "tempest-keypair-734768784", "user_data": "}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:22:29.344678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:29.347011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:29.358083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:29.358636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:29.359208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:29.360059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:29.360691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:29.361362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:29.467362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:29.497603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb184073-8f4b-4ca5-8c4b-14a5f2d877e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.156608 Sep 01 08:22:29.498638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] validate_networks() for [('65699cbd-f387-4c8e-aac1-9e9e4b156099', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:22:29.499887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 853/1682] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:29 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:29.527032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b76a578a-f41c-464d-8659-65006cb132d8 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Calling method '.version_select at 0x7f2ac29e7700>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:29.629563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b76a578a-f41c-464d-8659-65006cb132d8 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765" status: 200 len: 354 microversion: 2.1 time: 0.127616 Sep 01 08:22:29.630557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 854/1683] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:22:29 2022] GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765 => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:22:29.635687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:29.636308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:29.649792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:29.650302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:29.653562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:29.655031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:29.655527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:29.655969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:29.802421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:29.818378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7dcf2459-0c5e-440d-9a98-87fe2e9ae0a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.186697 Sep 01 08:22:29.835321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 855/1684] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:29 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:29.851021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-516392fc-dfe9-4e99-9354-46a1be7a9ea3 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Calling method '.version_select at 0x7f2ac29e7940>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:29.923974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-516392fc-dfe9-4e99-9354-46a1be7a9ea3 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765" status: 200 len: 354 microversion: 2.1 time: 0.083839 Sep 01 08:22:29.925652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 856/1685] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:22:29 2022] GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:22:29.947215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-34966d38-5a25-4b80-b1dd-537a87dbc001 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Calling method '.version_select at 0x7f2ac29c8310>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:30.060279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-34966d38-5a25-4b80-b1dd-537a87dbc001 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765" status: 202 len: 0 microversion: 2.1 time: 0.119028 Sep 01 08:22:30.062245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 857/1686] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Sep 1 08:22:29 2022] DELETE /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 08:22:30.076187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-362ad96c-35de-4012-9a66-0e188cfcfd8a tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Calling method '.version_select at 0x7f2ac29bfa60>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:30.133896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-362ad96c-35de-4012-9a66-0e188cfcfd8a tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765" status: 200 len: 353 microversion: 2.1 time: 0.067507 Sep 01 08:22:30.135209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 858/1687] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:22:30 2022] GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:22:30.253958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:30.256336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:30.257898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:22:30.258375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:22:30.258856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:22:30.259275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:22:30.259720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:22:30.261128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:30.266602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.267396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.268039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:30.269041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.269714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.270388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:30.271081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.271586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.272027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:30.272958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.273423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.273852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:30.299267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for project 631e2e8467654c0ea799bf50fed7afad. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:22:30.307148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Getting quotas for user 7559a0b8d46b4524b40f68b992f6cfe9 and project 631e2e8467654c0ea799bf50fed7afad. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:22:30.321604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:22:30.325379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:22:30.360993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:30.405347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:30.422040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2ea8a93d-2eb9-4ab6-b343-3de3a23133cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.172420 Sep 01 08:22:30.425334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 830/1688] 10.222.0.43 () {62 vars in 1188 bytes} [Thu Sep 1 08:22:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 08:22:30.432894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-904dfc44-f3ad-4f98-bcf5-bfdb72bbeaa6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.170850 Sep 01 08:22:30.437442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 859/1689] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:30 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:30.449738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-436342df-9e05-4442-bdfd-98c503dee8b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:30.450426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-436342df-9e05-4442-bdfd-98c503dee8b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:30.529988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-436342df-9e05-4442-bdfd-98c503dee8b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:30.537596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:30.539339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:30.546183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-436342df-9e05-4442-bdfd-98c503dee8b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:30.551798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-436342df-9e05-4442-bdfd-98c503dee8b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:30.554950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-436342df-9e05-4442-bdfd-98c503dee8b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1280 microversion: 2.20 time: 0.121036 Sep 01 08:22:30.555271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.559646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.559974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 831/1690] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:30 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:22:30.560984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:30.565311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.566291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.567019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:30.725962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:30.765187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6e1547ca-c442-47d6-b8c9-ddd320aefa7d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.232297 Sep 01 08:22:30.770609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 860/1691] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:30 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:30.844630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:30.845227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:30.856407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.858017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.860526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:30.862648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:30.864239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:30.864597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:31.035665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:31.053696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-da8ab91f-aaf6-40f0-a177-3fdf81789ffe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.215412 Sep 01 08:22:31.071998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 832/1692] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:30 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:31.162443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f37304a7-9da9-401d-8406-fa0d891d6186 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Calling method '.version_select at 0x7f2ac29bfb80>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:31.237486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-f37304a7-9da9-401d-8406-fa0d891d6186 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] HTTP exception thrown: Volume 65f722f3-204c-4385-864d-d84a63f80765 could not be found. Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f37304a7-9da9-401d-8406-fa0d891d6186 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Request method failure captured: Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765 HTTP/1.1 Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGvDPjP6frNxlNQIFMGhXH45QWQ6WlZPY5siYQguxqS3DnweiXWW8CLNmewHiw_0EWEAq-4ue_2FL6i4On6IJ1MbQLjHLJv6c-8j5nxBWaTeK9lSDHBWFHkgZCwUImwOotuCfY6gNA6nF6tXABACpKXjsNt7nbtT7vqvpFUY_l_Wx_Q Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 5d72fb44169d405dbf647ddb72b06934 Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesGetTestJSON-1076920805 Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:22:31.239514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d72fb44169d405dbf647ddb72b06934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d72fb44169d405dbf647ddb72b06934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d72fb44169d405dbf647ddb72b06934", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d72fb44169d405dbf647ddb72b06934"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesGetTestJSON-1076920805 Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 5d72fb44169d405dbf647ddb72b06934 Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesGetTestJSON-1076920805 Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesGetTestJSON-1076920805-project Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: 71d7b406ff944c23b7e947ae0eae73ed Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesGetTestJSON-1076920805-project Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Volume 65f722f3-204c-4385-864d-d84a63f80765 could not be found. Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '65f722f3-204c-4385-864d-d84a63f80765'} Sep 01 08:22:31.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65f722f3-204c-4385-864d-d84a63f80765 could not be found. (HTTP 404) (Request-ID: req-bb154cb2-5492-469e-8d29-cda0a556db76) Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:31.242048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 08:22:31.243610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65f722f3-204c-4385-864d-d84a63f80765 could not be found. Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 08:22:31.244939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65f722f3-204c-4385-864d-d84a63f80765 could not be found. Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65f722f3-204c-4385-864d-d84a63f80765 could not be found. Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f37304a7-9da9-401d-8406-fa0d891d6186 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] Returning 404 to user: Volume 65f722f3-204c-4385-864d-d84a63f80765 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f37304a7-9da9-401d-8406-fa0d891d6186 tempest-VolumesGetTestJSON-1076920805 tempest-VolumesGetTestJSON-1076920805-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765" status: 404 len: 109 microversion: 2.1 time: 0.094914 Sep 01 08:22:31.246380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 861/1693] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:22:31 2022] GET /compute/v2.1/os-volumes/65f722f3-204c-4385-864d-d84a63f80765 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 08:22:31.457551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:31.458797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:31.470866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1968560533", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fa62a9c-7a6e-4c3a-b7c4-bcbe5e7ff18a"}], "security_groups": [{"name": "tempest-securitygroup--1336302428"}], "key_name": "tempest-keypair-1648294146", "user_data": "}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:22:31.483891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:31.484387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:31.484828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:31.485547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:31.486003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:31.486475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:31.587193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:31.596128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c1eb9b55-9467-4fed-9d6d-75f154c468b3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.142614 Sep 01 08:22:31.596821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 833/1694] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:31 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:31.608663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:31.609621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:31.619555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:31.620333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:31.622162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:31.623478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:31.625236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:31.625983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:31.643037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] validate_networks() for [('9fa62a9c-7a6e-4c3a-b7c4-bcbe5e7ff18a', None, None, None, None, None)] {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:22:31.746204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:31.758521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:31.760468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:31.761450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d3d31cf-d2d6-4495-8318-0d1c57f65ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.157837 Sep 01 08:22:31.762534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 834/1695] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:31 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:31.789811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:31.790410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:31.800118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:31.800993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:31.801598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:31.802553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:31.803245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:31.803844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:31.983102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:31.995900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f7a5d4f2-2640-43b4-85ae-e4e5dcdcc469 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.210679 Sep 01 08:22:31.997195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 835/1696] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:31 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:32.092356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:32.093366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:32.099588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.100426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.101223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.102107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.102936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.103070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.107476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:32.254205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:32.267689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4725d32e-35a0-464c-85fa-3d15ccd7be38 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.179126 Sep 01 08:22:32.270215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 836/1697] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:32 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:32.476591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:22:32.477397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:22:32.478440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:22:32.478440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:22:32.478440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:22:32.489529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.490018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.490489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.491239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.491697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.492127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.516586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:22:32.529226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for user ccd2c619e9fc436ea01a1200bc46b60f and project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:22:32.559118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:22:32.565473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:22:32.628897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:32.629574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:32.641850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-94c213f5-f4d4-4d4e-a387-b02ae88f590b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.175310 Sep 01 08:22:32.643260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 862/1698] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:22:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:22:32.654672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2b9308ec-bf99-4aed-a5cb-62410d4abac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:32.655218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2b9308ec-bf99-4aed-a5cb-62410d4abac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:32.665113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.665759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.666213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.666970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.667424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.667842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.718743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2b9308ec-bf99-4aed-a5cb-62410d4abac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:32.730232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2b9308ec-bf99-4aed-a5cb-62410d4abac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1242 microversion: 2.1 time: 0.076957 Sep 01 08:22:32.730974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 863/1699] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:32 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:32.784870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:32.785525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:32.794513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.795756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.796207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.797439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:32.798804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:32.800212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:32.807811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:32.819420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e7043a5f-c390-4c87-ad12-bd4c11f186c8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.205441 Sep 01 08:22:32.832065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 837/1700] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:32 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:32.927264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:32.942899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:32.945512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:32.947506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2424546-d2f4-41ee-8d16-9e71a4db9984 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.166805 Sep 01 08:22:32.948427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 864/1701] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:32 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:22:33.019326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:33.019941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:33.030939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.031817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.032548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.033508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.034361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.035780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.117533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:33.133483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e8da286f-01c0-44b5-aceb-04ac5b277152 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.117370 Sep 01 08:22:33.134867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 838/1702] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:33 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:33.292572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:33.293101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:33.299721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.300270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.300735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.301455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.301911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.302374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.369627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:33.379121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3258339c-a501-401b-ab7c-77275ddfab0f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090897 Sep 01 08:22:33.379705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 865/1703] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:33 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:33.751935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:33.752564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:33.758738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.759231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.759665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.760373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.760954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.761383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.837231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:33.845483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:33.846067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6db6aa40-f542-4066-a1df-f9b0b6de5062 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.097690 Sep 01 08:22:33.846525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 839/1704] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:33 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:33.854702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:33.863047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.863626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.864303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.865342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.865680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.865931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.939881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:33.947937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20012e9c-4bf8-413f-aab8-90aaf357e26e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.110176 Sep 01 08:22:33.948512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 866/1705] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:33 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:33.972903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:33.973647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:33.981152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.981641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.982082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:33.982814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:33.992469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:33.992469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.055213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:34.065804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:34.067731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:34.068865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2125cc6d-8c76-4355-a7bd-0d8a9cf9786b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.100545 Sep 01 08:22:34.069426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 840/1706] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:33 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:34.158670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:34.159856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:34.166153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.166759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.167261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.167963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.169174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.169956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.244690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:34.254043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47e05bb2-252f-4610-b56b-ccd2bfb1cf86 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.102189 Sep 01 08:22:34.254771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 867/1707] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:34 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:34.409364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:34.409945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:34.416695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.417058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.417495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.418218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.418950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.419584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.494363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:34.510764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7083f47e-ff28-4a3b-87cc-2c9aa08a6f86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.106184 Sep 01 08:22:34.517881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 841/1708] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:34 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:34.872343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:34.872946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:34.878967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.879447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.879870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.880560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.881003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.881417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.945692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:34.954212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ee383d3-ff78-4b07-8f5e-270d79b336f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085989 Sep 01 08:22:34.954840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 868/1709] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:34 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:34.970430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:34.971059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:34.977684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.978191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.978653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:34.979374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:34.979824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:34.980247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.049755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:35.059746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0c9974f-9ced-428f-b16a-263c3faf66b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.094416 Sep 01 08:22:35.060326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 842/1710] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:34 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:35.095642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:35.096307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:35.102889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.103382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.103826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.104536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.104983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.105406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.171096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:35.182140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:35.183632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:35.185162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2e9019b-e7a8-44f6-9e26-1aa084c80faf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095996 Sep 01 08:22:35.185962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 869/1711] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:35 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:35.276249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:35.276849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:35.283675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.284148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.284574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.285259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.285699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.286115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.354018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:35.365071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0edd3e1-d051-4b08-9c64-aed75fe7899e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.092366 Sep 01 08:22:35.365820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 843/1712] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:35 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:35.535281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:35.535895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:35.541980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.542564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.542998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.543771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.544219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.544628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.625340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:35.633753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25373ee3-d5b5-4a55-a23c-9198c207356c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.102741 Sep 01 08:22:35.634372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 870/1713] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:35 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:35.976962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:35.977655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:35.984574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.985080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.985507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:35.986203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:35.986686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:35.987136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.053934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:36.062082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d134032-18de-4e4a-9de9-19e427f0b9fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089161 Sep 01 08:22:36.062695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 844/1714] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:35 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:36.086692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:36.087313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:36.094362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.094854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.095290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.095993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.096465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.096888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.166918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:36.175162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25a3d661-050b-4895-a8d0-0048e055d480 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.098111 Sep 01 08:22:36.175762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 871/1715] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:36 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:36.208030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:36.208622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:36.216125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.216609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.217064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.217744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.218191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.218638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.286224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:36.295281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:36.296701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:36.297808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-818ab39f-3725-41d4-9cfa-161c7dffd13b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093877 Sep 01 08:22:36.298384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 845/1716] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:36 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:36.385994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:36.386617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:36.393393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.393892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.394335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.395033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.395478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.395893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.468004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:36.476610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8529ce39-21a0-4af4-9fc6-a5fc81f24687 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.094391 Sep 01 08:22:36.477184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 872/1717] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:36 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:36.669615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:36.670121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:36.675978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.676444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.676868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.677548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:36.677987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:36.678430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:36.741922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:36.749757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-deae1dd4-0922-47dd-a697-54eefb5ca8aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084685 Sep 01 08:22:36.750423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 846/1718] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:36 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:37.084836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:37.085613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:37.093145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.093807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.094390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.095332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.095940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.096475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.165184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:37.173198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a460bd65-3821-43aa-8f0b-f9667fd6d507 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.092102 Sep 01 08:22:37.173775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 873/1719] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:37 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:37.195741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:37.196287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:37.203268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.203989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.204172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.204868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.205310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.205725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.268198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:37.275872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-84b7f60e-0831-47ce-9bb6-4d34fe4ab6ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084044 Sep 01 08:22:37.276440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 847/1720] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:37 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:37.320084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:37.320686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:37.326815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.327293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.327753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.328441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.328887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.329309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.389836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:37.397825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:37.399272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:37.400451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8673f9ab-53b1-4a04-b322-eed0b8028e68 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084266 Sep 01 08:22:37.401059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 874/1721] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:37 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:37.497132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:37.497729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:37.503686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.504207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.504590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.505272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.505713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.506275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.572918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:37.584505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-76659263-4698-4455-8a01-0022e7d66f39 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.091264 Sep 01 08:22:37.585087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 848/1722] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:37 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:37.772320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:37.772837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:37.779713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.780183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.780602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.781282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:37.781715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:37.782127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:37.796725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:37.843168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:37.850708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-49a0ff24-11d1-4c74-92ba-e15066e39d89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082258 Sep 01 08:22:37.851270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 875/1723] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:37 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:38.195492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:38.195492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:38.201687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.202231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.202698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.203385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.203833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.204245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.270836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:38.279302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e5259c48-6d6b-4dc1-8939-001fd9eda3bc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088797 Sep 01 08:22:38.279910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 849/1724] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:38 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:38.297145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:38.297753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:38.303798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.304275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.304712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.305409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.305859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.306357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.370011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:38.378143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d44d2ff-9c9c-4c08-9688-24c10ea56697 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084928 Sep 01 08:22:38.378740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 876/1725] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:38 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:38.423986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:38.424497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:38.430595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.431076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.431503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.432200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.432643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.433052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.499771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:38.508102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:38.509509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:38.510620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e667a336-8e5a-48ce-ab04-fc41bbbd9d1b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090651 Sep 01 08:22:38.511168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 850/1726] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:38 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:38.606374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:38.606980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:38.613024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.613500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.613940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.614671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.615125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.615546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.679552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:38.688298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0cd06c41-10bd-4b1c-b556-e534941f83a8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086010 Sep 01 08:22:38.688908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 877/1727] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:38 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:38.872549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:38.873159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:38.879128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.879601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.880025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.880710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:38.881154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:38.881564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:38.943954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:38.952298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-363a5a9e-807e-43ce-8ee8-7851bcfe8248 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084074 Sep 01 08:22:38.952857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 851/1728] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:38 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:39.300603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:39.301197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:39.307550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.308019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.308443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.309749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.310188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.310634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.373648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:39.381741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c00ef56b-ee0c-4f7d-a221-d6b1a2e36d88 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084928 Sep 01 08:22:39.382349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 878/1729] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:39 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:39.400418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:39.401025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:39.408089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.408888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.409315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.410018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.410498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.410921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.491514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:39.495007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:39.500890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2bcf792a-89bc-4316-b39f-1249a1c269eb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.104266 Sep 01 08:22:39.501502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 852/1730] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:39 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:39.536686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:39.537411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:39.548407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.549202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.549882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.551065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.551794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.552452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.620406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:39.630297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:39.632226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:39.633366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1e0f47f3-b9f2-4dec-a3f8-408a1838ae05 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.103571 Sep 01 08:22:39.633930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 879/1731] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:39 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:22:39.708781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:39.709395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:39.716118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.716597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.717026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.717726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.718172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.718615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.779890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:39.787557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-10938a29-021c-4f87-abb0-b7bbbc848b49 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082721 Sep 01 08:22:39.788117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 853/1732] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:39 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:39.973175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:39.973779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:39.979659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.980135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.981120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:39.981854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:39.982325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:39.982748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.043749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:40.052993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13770fe0-f6b3-418f-a722-34666335a5d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083644 Sep 01 08:22:40.053792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 880/1733] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:39 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:40.411089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:40.412226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:40.417185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=4 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:40.424616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.425132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.425573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.426302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.426758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.428065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.501250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:40.509713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-125aa680-82ca-42ae-b407-a24d410b4005 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.107915 Sep 01 08:22:40.510320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 854/1734] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:40 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:40.521194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:40.521798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:40.528764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.529254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.529688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.530432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.530886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.531307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.609196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:40.617475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fb5df22b-be04-41bd-8162-8173cfc6a4b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.100088 Sep 01 08:22:40.618059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 881/1735] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:40 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:40.659295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:40.659980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:40.661837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=20 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:40.668671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.669389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.669973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.670972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.671553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.672263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.752611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:40.761282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:40.763691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:40.764906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b7aa3fbd-3d83-457f-bd13-6615b68ad7e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.110917 Sep 01 08:22:40.765453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 855/1736] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:40 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:40.809264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:40.809892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:40.815889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.816369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.816795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.817483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:40.817926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:40.818358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:40.884286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:40.893017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f04116e9-cc45-430a-9c6f-01ec4e7579fa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087925 Sep 01 08:22:40.893591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 882/1737] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:40 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:41.077327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:41.077966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:41.084183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.084660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.085090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.085771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.086216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.086943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.149894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:41.157497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1e4f94de-99e5-41cb-bb37-cf46770e5539 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084990 Sep 01 08:22:41.158052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 856/1738] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:41 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:41.538022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:41.538022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:41.544245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.544721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.545151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.545855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.546313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.546730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.610047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:41.617700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1df721e-990b-478b-a7fc-3b88405233d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084143 Sep 01 08:22:41.618440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 883/1739] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:41 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:41.639054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:41.639772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:41.645709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.646184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.646646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.647330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.647771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.648183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.715178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:41.723034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c5ff0b3-7a8c-40ca-8da4-50a8ace66483 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088468 Sep 01 08:22:41.723524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 857/1740] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:41 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:41.788740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:41.789422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:41.795839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.796307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.796729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.797415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.797853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.798280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.861231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:41.869649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:41.871685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:41.872805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ab1d5bb7-cc75-4828-913c-052878d2afb0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088657 Sep 01 08:22:41.873372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 884/1741] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:41 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:41.914092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:41.914731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:41.923820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.924690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.925476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:41.926755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:41.927607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:41.928409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.002400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:42.010565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-42d63268-02de-41bc-bfe6-13d44f9601e9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.100275 Sep 01 08:22:42.011148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 858/1742] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:41 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:42.179220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:42.179837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:42.186919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.187419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.187863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.188658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.189103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.189523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.251937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:42.259568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c4f29de-a477-4527-962a-903953509d72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084124 Sep 01 08:22:42.260143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 885/1743] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:42 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:42.639032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:42.639642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:42.645696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.646175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.646634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.647326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.647777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.648195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.709300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:42.717948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c799209d-ebbd-453b-975c-e308e8752498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083100 Sep 01 08:22:42.718541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 859/1744] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:42 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:42.748672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:42.749286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:42.751191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:42.751883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=16 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:42.757601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.758086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.758545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.759239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.759687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.760111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.821730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:42.830203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-80a07f23-6a1f-4568-9cd1-4fc44473f24c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085256 Sep 01 08:22:42.830813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 886/1745] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:42 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:42.895962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:42.896489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:42.903239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.903730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.904157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.904859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:42.905307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:42.905731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:42.971075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:42.979293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:42.981236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:42.982355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-111ab91c-b0a1-4a9f-81a1-e61d990b6d86 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090581 Sep 01 08:22:42.982902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 860/1746] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:42 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:43.032557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:43.033152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:43.039024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.039493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.039922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.040593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.041033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.041449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.105577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:43.113393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c88392af-b100-4aae-b969-03ce36693708 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084685 Sep 01 08:22:43.113957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 887/1747] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:43 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:43.281981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:43.282896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:43.290346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.290835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.291265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.292031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.292584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.293081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.359443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:43.368138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-95036a1e-9674-4d24-8282-8e2ccd9cba23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090533 Sep 01 08:22:43.368400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 861/1748] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:43 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:43.738727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:43.739368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:43.745849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.746410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.746878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.747571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.748013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.748443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.810556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:43.818697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0901615b-ab12-449e-bfa1-494ebd58cd79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083729 Sep 01 08:22:43.819259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 888/1749] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:43 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:43.851453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:43.852061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:43.858403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.858890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.859324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.860020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:43.860504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:43.860895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:43.928261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:43.936926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a6b2be9f-06e3-472d-8de5-45f2e5899bef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089114 Sep 01 08:22:43.937519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 862/1750] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:43 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:44.004828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:44.005440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:44.011476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.012583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.013017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.013715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.014163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.014618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.073975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:44.083003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:44.084430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:44.085521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7dd6d503-5490-4a8c-94b7-492aab445f78 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084742 Sep 01 08:22:44.086672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 889/1751] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:43 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:44.134429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:44.135032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:44.141442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.141918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.142370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.143051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.143491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.143906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.204437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:44.212584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3f538fb7-22bf-4a22-a4fd-985a84aa873e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081901 Sep 01 08:22:44.213150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 863/1752] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:44 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:44.388285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:44.389176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:44.395125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.395595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.396018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.396720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.397161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.397577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.457936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:44.466141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e4efbb59-00eb-4eaf-a18b-60e17c44ad5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082463 Sep 01 08:22:44.466739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 890/1753] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:44 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:44.840093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:44.840712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:44.846759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.847240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.847668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.848362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.848825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.849241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.924444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:44.934054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b13173e-77ea-4d5b-94bb-89b662092770 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.097482 Sep 01 08:22:44.935053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 864/1754] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:44 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:44.958428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:44.958982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:44.967051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.967636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.968251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:44.969038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:44.969562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:44.970056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.036999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:45.045728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9e068be-6e67-448f-9af8-2f3ce867ee40 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091135 Sep 01 08:22:45.046337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 891/1755] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:44 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:45.112490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:45.113630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:45.124948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.125620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.126096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.126831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.127296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.127723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.192815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:45.202428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:45.203894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:45.205041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc92cc11-dcc6-4801-ac57-37b835a1928e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.100610 Sep 01 08:22:45.205705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 865/1756] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:45 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:45.233410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:45.234027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:45.240728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.241356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.242075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.242921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.243373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.243875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.246707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:45.304810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:45.312738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-390e945c-8bb9-4561-9a7a-fa5729469497 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083631 Sep 01 08:22:45.313294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 892/1757] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:45 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:45.487525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:45.488140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:45.494456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.494939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.495370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.496620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.497580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.498172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.564249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:45.571850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-33240474-db1a-479b-8fe6-ff2f86a0d196 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088570 Sep 01 08:22:45.572410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 866/1758] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:45 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:45.958949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:45.960032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:45.971132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.971913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.972617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:45.973757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:45.974537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:45.975296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.063809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:46.073349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:46.074772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:46.078293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2cc1e3e5-ae0c-4331-96c5-4fe20cb5a9bf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.125640 Sep 01 08:22:46.079309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 893/1759] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:45 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:46.084220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.084821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.085341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.086453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.087175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.087598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.162971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:46.171077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b7a16deb-11d1-4b96-88bc-33b82fb41b9f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.106585 Sep 01 08:22:46.171651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 867/1760] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:46 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:46.228903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:46.229846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:46.236775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.237237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.237671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.238407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.238854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.239471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.309913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:46.319201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:46.320634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:46.321886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13d84873-5847-4165-9cfb-6453e844a1e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096873 Sep 01 08:22:46.322661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 894/1761] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:46 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:46.341958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:46.342599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:46.348650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.349123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.349560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.350234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.350702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.351113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.415266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:46.423538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-586819d1-bf0e-4eb6-849b-133ecd21385c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086243 Sep 01 08:22:46.424106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 868/1762] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:46 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:46.593745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:46.594363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:46.600635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.601112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.601537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.602218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:46.602704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:46.603118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:46.663723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:46.671418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f0eeb31c-dd94-4cab-b24b-5394a80ba4aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082120 Sep 01 08:22:46.671978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 895/1763] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:46 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:47.113504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:47.114116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:47.120050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.120517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.121447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.122126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.122587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.123001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.141913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:47.184717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:47.192291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:47.192785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04d3dd90-4406-4a32-b85a-05994f81d89e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083222 Sep 01 08:22:47.192886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:47.205072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 869/1764] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:47 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:47.205265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.205265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.205265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.205265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.205639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.205639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.265684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:47.273697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc21e44f-2ac5-4eb1-9b5f-358bd58d1092 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085061 Sep 01 08:22:47.274420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 896/1765] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:47 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:47.345806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:47.346528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:47.352677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.353274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.353739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.354469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.354917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.355519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.424895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:47.433042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:47.435336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:47.436426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c42081cd-bb8e-45d2-8580-071ccc0266f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094625 Sep 01 08:22:47.439465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 870/1766] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:47 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:47.443238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:47.443851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:47.450685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.451170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.451606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.452369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.452849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.453378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.671995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:47.682494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f690ac0d-7ce8-42c0-9fcb-3ee6ce4ee18a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.243046 Sep 01 08:22:47.683072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 897/1767] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:47 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:47.694104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:47.695839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:47.703408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.703906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.704338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.705042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:47.705495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:47.705915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:47.776242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:47.784416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd7b38f4-e9ac-46ca-9f7b-97dcb060e54f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.095198 Sep 01 08:22:47.784971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 871/1768] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:47 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:48.214799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:48.215472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:48.221551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.222032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.222493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.223185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.223634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.224052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.288754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:48.296181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:48.296788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:48.297985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d05a1138-2bbf-4c6c-9d4e-ee565f9952a1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088108 Sep 01 08:22:48.298591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 898/1769] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:48 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:48.303100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.303581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.304012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.304697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.305147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.305565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.368676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:48.377295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4af0f204-2735-4cae-be7b-a4c3a0610113 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085282 Sep 01 08:22:48.377759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 872/1770] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:48 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:48.461745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:48.462410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:48.469520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.469923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.470409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.471112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.471565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.472008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.537448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:48.548334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:48.550006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:48.551141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ebe296e-cf72-47e4-8d75-06d23eb2c282 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093656 Sep 01 08:22:48.551689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 899/1771] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:48 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:48.703607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:48.704213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:48.710232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.710738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.711423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.712098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.712544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.712961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.772751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:48.781109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-069b07a6-d63e-4e6a-8da3-d4eed5bf63e5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081885 Sep 01 08:22:48.781685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 873/1772] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:48 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:48.805618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:48.806331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:48.813006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.813637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.814137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.814975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:48.815498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:48.815983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:48.879914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:48.888474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3eef36ca-fa2b-469e-9631-baf1e52b689e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086538 Sep 01 08:22:48.889136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 900/1773] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:48 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:49.319179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:49.319807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:49.326746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.327229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.327653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.328349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.328787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.329205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.391089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:49.398530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:49.399137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:49.399837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b50da0c-88a9-4dfd-9bcf-3fbf820d9e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084451 Sep 01 08:22:49.400494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 874/1774] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:49 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:49.401169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:49.407796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.408381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.408927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.410215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.410215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.410689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.479360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:49.487934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6dcc236a-5151-44ed-8afb-0ae000197c1e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.093127 Sep 01 08:22:49.488519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 901/1775] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:49 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:49.575487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:49.576035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:49.582470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.582972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.583407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.584112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.584558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.584981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.649399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:49.659056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:49.660524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:49.661617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ceea99f0-dfb7-4ee3-942e-bb0d97fc7989 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091079 Sep 01 08:22:49.662175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 875/1776] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:49 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:49.802820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:49.803459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:49.810159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.810683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.811114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.811819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.812267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.812691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.880271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:49.889223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f7c50d5-babc-4b33-b1f1-a81f13eb2459 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090141 Sep 01 08:22:49.889810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 902/1777] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:49 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:49.908988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:49.909638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:49.923862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.924427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.924890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.925634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:49.926152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:49.926629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:49.991403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:49.999511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9016622-1fa0-4bfe-a77e-39e38922ab02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094300 Sep 01 08:22:50.000130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 876/1778] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:49 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:50.423088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:50.423731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:50.429682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.430155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.430618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.431312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.431759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.432294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.499936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:50.508687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9ff5109-ebfa-4f23-b823-b42588a554e3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089618 Sep 01 08:22:50.509263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:50.509900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 903/1779] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:50 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:50.510055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:50.518654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.519137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.519562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.520255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.520755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.521178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.594358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:50.602434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb628093-f755-449f-a891-71d8958d9c08 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.097267 Sep 01 08:22:50.603035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 877/1780] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:50 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:50.685591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:50.686108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:50.692211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.692689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.693116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.693807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.694248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.694691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.757032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:50.765932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:50.767392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:50.768488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dcaa7f7d-bb93-4557-bb3b-f17c54d89587 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087587 Sep 01 08:22:50.769045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 904/1781] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:50 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:50.909067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:50.909671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:50.915724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.916208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.916634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.917313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:50.917795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:50.918304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:50.979779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:50.988208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8d0cd268-544b-4c76-96ed-798289be677e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082966 Sep 01 08:22:50.988771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 878/1782] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:50 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:51.020552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:51.021151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:51.027188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.027669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.028098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.028782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.029226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.029639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.100331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:51.109908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2a9fe710-0c31-4bcc-a162-5f0a533f002a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.093077 Sep 01 08:22:51.110631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 905/1783] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:51 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:51.530403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:51.531100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:51.533084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:51.539194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.539685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.540123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.540839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.541290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.541716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.605081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:51.613479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ff8a3f13-103d-4057-befc-681b46dfaf58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087595 Sep 01 08:22:51.614050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 879/1784] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:51 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:51.624164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:51.624862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:51.631820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.632299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.632763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.633461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.633917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.634376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.698783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:51.707037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-98b8f2e9-8e8b-4c9e-8fa2-1e3d7fe7ee8f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087536 Sep 01 08:22:51.707603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 906/1785] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:51 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:51.791531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:51.792446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:51.800552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.801036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.801462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.802156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:51.802628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:51.803043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:51.869962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:51.880219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:51.881644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:51.882780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ac1d1c9-ace6-47c0-a238-07b3dc715a79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095884 Sep 01 08:22:51.883342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 880/1786] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:51 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:52.009607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:52.010213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:52.017400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.017914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.018393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.019114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.019562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.019981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.086807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:52.095392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae2045ea-f6c7-4607-b8d9-f1ea229591ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.089578 Sep 01 08:22:52.095975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 907/1787] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:52 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:52.132508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:52.133032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:52.139888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.140583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.141682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.142692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.143193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.143795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.209296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:52.217691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fac6422d-2f90-44cc-8881-128019a4b557 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089086 Sep 01 08:22:52.218248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 881/1788] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:52 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:52.634918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:52.635506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:52.642756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.643245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.643674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.644376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.644821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.645237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.709031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:52.711530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:52.718900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c34be1f7-25b8-4ee0-9f1e-bd01c3e4f5ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087847 Sep 01 08:22:52.719558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 908/1789] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:52 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:52.728589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:52.729130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:52.735789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.736258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.736682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.737367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.737803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.738216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.799983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:52.807959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-329fb441-4d35-442c-a28d-dce9ee65133e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083251 Sep 01 08:22:52.809264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 882/1790] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:52 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:52.906769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:52.907454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:52.913987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.914508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.914941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.915638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:52.916088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:52.916508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:52.986302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:52.995008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:52.996781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:52.997889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a72bb86f-3813-4c2d-b313-1bc342ef8632 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096111 Sep 01 08:22:52.998476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 909/1791] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:52 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:53.115791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:53.116403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:53.122548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.123039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.123479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.124194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.124651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.125073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.185859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:53.193466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-55c2789f-b049-4390-bc7a-dbf35b1c9282 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081578 Sep 01 08:22:53.194037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 883/1792] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:53 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:53.238598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:53.239142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:53.246032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.246543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.246990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.247651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.248103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.248673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.312322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:53.320080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a568e51f-4909-448d-99dc-25731f95dc08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085739 Sep 01 08:22:53.320627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 910/1793] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:53 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:53.741184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:53.742026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:53.750209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.750856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.751616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.752528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.752986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.753647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.823715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:53.829808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:53.830510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:53.832668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-94a3a338-9a3b-441b-9430-42d58b09f905 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.095301 Sep 01 08:22:53.833598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 884/1794] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:53 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:53.837654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.838139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.838598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.839300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:53.839737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:53.840186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:53.905616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:53.915285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0d5a53b2-c001-421b-9edc-1ee1b53a66b4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089079 Sep 01 08:22:53.915872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 911/1795] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:53 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:54.020779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:54.021416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:54.028643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.029176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.029615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.030365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.030822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.031346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.095562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:54.103569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:54.105843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:54.107623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9b34f32d-01ca-421d-8096-2e2871eb6169 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090608 Sep 01 08:22:54.108356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 885/1796] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:54 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:54.219299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:54.219832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:54.225924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.226436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.226861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.227542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.227983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.228394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.295498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:54.303336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a404281-c53c-4730-b012-ffd415c81467 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.088365 Sep 01 08:22:54.303911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 912/1797] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:54 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:54.342275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:54.343516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:54.350777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.351259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.351684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.352377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.352818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.353229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.357490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:54.422180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:54.431485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f7e325e1-4be9-45c2-92e0-36c38f7a8071 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.093683 Sep 01 08:22:54.432193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 886/1798] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:54 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:54.853555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:54.854564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:54.861905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.862923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.863418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.864231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.864749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.865184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.934614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:54.942553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2a96c8a3-902c-48df-b75f-1ce7754632c8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.093215 Sep 01 08:22:54.943127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 913/1799] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:54 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:54.945264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:54.945879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:54.953385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.953873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.954675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:54.955372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:54.956704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:54.957147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.024106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:55.036069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47a3b831-db86-4551-ac25-1531b8c50a59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.094719 Sep 01 08:22:55.036627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 887/1800] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:54 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:55.133087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:55.134087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:55.143145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.144050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.144903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.145832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.146663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.147294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.231878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:55.241620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:55.242620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:55.243184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6382ef65-891e-4643-8a4b-d9818b274897 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.116624 Sep 01 08:22:55.243830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 914/1801] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:55 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:55.325356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:55.325952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:55.331891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.332364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.332798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.333469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.333910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.334357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.398420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:55.406465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f206622-1129-4e97-b87b-efb6719e9fc4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085689 Sep 01 08:22:55.412413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 888/1802] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:55 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:55.453636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:55.454300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:55.460360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.460830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.461521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.462250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.462705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.463122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.531149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:55.539318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8cc9ffba-ebea-4fb9-9a05-a816b38d492c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090398 Sep 01 08:22:55.539890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 915/1803] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:55 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:55.965752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:55.966652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:55.972944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.973426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.973857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:55.974589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:55.975036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:55.975454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.039143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:56.047920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-74af59ef-1419-4246-8771-44604c2a9a73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087346 Sep 01 08:22:56.048499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 889/1804] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:55 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:56.056889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:56.057607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:56.064005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.064492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.064928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.065617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.066072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.066519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.135348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:56.143599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-60ee1a32-2383-4eff-add6-2b59cfbf04ab tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090401 Sep 01 08:22:56.144188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 916/1805] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:56 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:56.266788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:56.267478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:56.273570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.274039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.274516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.275205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.275645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.276061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.340805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:56.348875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:56.350350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:56.351446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93b6d816-8db2-409f-891d-36e90df940e6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089235 Sep 01 08:22:56.351995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 890/1806] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:56 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:56.428972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:56.429586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:56.435970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.436445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.436874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.437563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.438011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.438460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.507510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:56.515746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-70daef8e-4c94-424d-b317-498cb909d2d6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090600 Sep 01 08:22:56.516698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 917/1807] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:56 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:56.563820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:56.564336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:56.570221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.570719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.571151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.571841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:56.572424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:56.573053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:56.639773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:56.647297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f82aea82-f0d9-472a-b7c5-c5bb442e754b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087822 Sep 01 08:22:56.647856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 891/1808] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:56 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:57.068648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:57.069422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:57.077002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.077490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.077921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.078658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.079105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.079524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.147726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:57.156964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-975deb1f-0bd3-49a9-9220-6b9ccc428cde tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.092144 Sep 01 08:22:57.157541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 918/1809] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:57 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:57.164414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:57.165047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:57.171827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.172302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.172739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.173413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.173879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.174488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.238845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:57.246780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-406a3d39-b85f-4856-8476-34475bddbdc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085938 Sep 01 08:22:57.248073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 892/1810] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:57 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:57.374060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:57.374602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:57.380955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.381437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.381872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.382596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.383045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.383464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.449249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:57.457545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:57.459055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:57.460186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-becd4438-5dfc-4484-9261-3ba33d112d11 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090171 Sep 01 08:22:57.460769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 919/1811] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:57 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:57.540288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:57.540892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:57.547882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.548612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.548612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.550172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.550172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.550172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.614895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:57.622788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7d4b3830-7e76-4829-b802-38e462ba1e54 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086390 Sep 01 08:22:57.623626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 893/1812] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:57 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:57.669325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:57.670236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:57.676219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.676781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.677214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.677925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:57.678405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:57.678891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:57.744148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:57.752042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9895e90f-b9c1-4705-a0e7-2b890d197a12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087303 Sep 01 08:22:57.752591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 920/1813] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:57 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:58.178503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:58.179113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:58.186205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.186821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.187255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.187959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.188407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.188831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.256139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:58.264796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9562165-3757-4000-891e-32eb197195b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090142 Sep 01 08:22:58.265719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 894/1814] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:58 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:58.270017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:58.270805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:58.280718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.282563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.283193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.283800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.284264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.285320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.352566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:58.360153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8382fa3c-44cd-4fe8-aad7-50b8eccaff12 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095063 Sep 01 08:22:58.360719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 921/1815] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:58 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:58.485494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:58.486112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:58.493019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.493505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.493931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.494656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.495099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.495512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.559839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:58.568433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:58.569873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:58.571016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e851e76-128a-4d48-bdec-a917e33157c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090623 Sep 01 08:22:58.571568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 895/1816] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:58 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:58.645644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:58.646280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:58.652368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.652835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.653950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.654750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.655271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.655736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.716997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:58.724976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-561fa7a8-4acf-4b52-983b-be2b758d3003 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083094 Sep 01 08:22:58.725476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 922/1817] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:58 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:58.776327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:58.776933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:58.783734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.784209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.784636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.785311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:58.785752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:58.786165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:58.848062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:58.855875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b0602a1-e36c-47de-b6af-ea787fe53e8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083396 Sep 01 08:22:58.856447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 896/1818] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:58 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:59.287358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:59.287970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:59.297082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.297583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.298031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.299290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.299290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.299624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.367318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:59.378116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3bf4ba03-dc5a-4a89-b17c-3ea65f30a8b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094410 Sep 01 08:22:59.378887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 923/1819] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:59 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:59.381101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:59.381718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:59.387940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.388421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.388851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.389538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.390025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.390585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.451985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:59.459936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ada4ad5c-f6e1-47cc-8c1d-3970373a02e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082716 Sep 01 08:22:59.460756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 897/1820] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:59 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:22:59.594818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:59.595344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:59.601370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.601850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.602301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.603002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.603453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.603872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.668032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:59.678724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:59.680151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:59.681269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23f56523-f58f-42fc-8d5b-fc64a3e50cb1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090707 Sep 01 08:22:59.681868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 924/1821] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:22:59 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:22:59.745897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:59.747208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:59.753556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.754039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.754498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.755193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.755644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.756066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.819506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:59.828862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-757ac769-78c2-4021-8400-2a9491bd90c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086840 Sep 01 08:22:59.829431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 898/1822] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:59 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:22:59.877006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:22:59.877780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:22:59.884010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.884487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.884914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.885608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:22:59.886048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:22:59.886498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:22:59.902689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:59.952889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:22:59.960555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24ce6ccd-2172-4eab-9d38-64746d11b50a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087395 Sep 01 08:22:59.961385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 925/1823] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:22:59 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:00.400637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:00.401405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:00.408261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.408749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.409183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.409884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.410360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.410785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.474250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:00.482151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:00.482783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:00.483007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1331d055-cc9e-4146-9d50-79ea46660c0e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086203 Sep 01 08:23:00.483580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 899/1824] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:00 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:00.489466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.489944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.490538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.491126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.491568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.491985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.554388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:00.562286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2c98cfa-7ab3-4a49-98bb-c6c24af2e4b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084609 Sep 01 08:23:00.562852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 926/1825] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:00 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:00.704837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:00.705438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:00.711976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.712452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.712879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.713569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.714013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.714462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.777607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:00.787473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:00.788907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:00.790118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4797cc48-0ae1-4b6a-9a60-a760386b2bdb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089104 Sep 01 08:23:00.790593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 900/1826] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:00 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:00.848965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:00.849598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:00.855486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.855970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.856409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.857091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.857534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.857950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.920765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:00.928587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c32bf843-e2ef-459d-8355-3cf460040fd4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083527 Sep 01 08:23:00.929134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 927/1827] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:00 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:00.981288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:00.982100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:00.988546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.989070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.989502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:00.990193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:00.990665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:00.991085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.057235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:01.065964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e3d12489-949e-4dd6-b5f7-f0ae25039813 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088759 Sep 01 08:23:01.066579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 901/1828] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:00 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:01.503273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:01.503906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:01.509930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.510457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.510892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.511582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.512030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.512996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.585329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:01.589726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:01.591514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:01.596509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fc076b3f-80f5-49ca-8c45-2011f7cbd6d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.096726 Sep 01 08:23:01.597229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 928/1829] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:01 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:01.605810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.606442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.607262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.607881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.608477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.608911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.674484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:01.677813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:01.682899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dba3b23b-5c09-4171-b2c9-66da8729a4e0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.102490 Sep 01 08:23:01.683457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 902/1830] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:01 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:01.817922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:01.818573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:01.825399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.826209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.826752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.827514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.827978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.828411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.898678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:01.906887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:01.908307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:01.909418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4fbbeaaa-a341-4aba-abe7-2b1a8466e1cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095563 Sep 01 08:23:01.909975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 929/1831] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:01 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:01.950342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:01.951151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:01.957045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.958822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.958822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:01.958822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:01.959137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:01.959528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.024108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:02.031686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4414ab49-cfa2-43a7-acab-3afc2a20b447 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086121 Sep 01 08:23:02.032245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 903/1832] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:01 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:02.088295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:02.088910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:02.095655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.096234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.096567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.097284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.097742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.098168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.158079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:02.165600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-340f6d36-c766-41c3-9852-11c54975403f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081471 Sep 01 08:23:02.166146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 930/1833] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:02 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:02.619232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:02.619836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:02.626582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.627060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.627486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.628191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.628632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.629048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.694535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:02.703364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9c642155-9100-4286-841a-e33b962725fc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087843 Sep 01 08:23:02.703641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:02.704138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 904/1834] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:02 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:02.704256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:02.710492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.711237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.711662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.712350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.712790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.713207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.776208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:02.785194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f474427c-72d6-4092-a31d-ef3255e41451 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085877 Sep 01 08:23:02.785756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 931/1835] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:02 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:02.937361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:02.938421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:02.945459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.946060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.946607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:02.947446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:02.947954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:02.948602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.016094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:03.025052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:03.026522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:03.028568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-13ed7683-4008-459d-83b9-69cda29506cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.097203 Sep 01 08:23:03.028819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 905/1836] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:02 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:03.051531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:03.052172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:03.058449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.058933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.059586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.060378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.060840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.061265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.147003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:03.155426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7e9f516-22eb-49c8-8869-ec1c2600daf6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.107744 Sep 01 08:23:03.155977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 932/1837] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:03 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:03.187171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:03.187782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:03.193703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.194181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.194675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.195391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.195840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.196260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.257337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:03.265156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8ede8923-82cb-4358-b6d4-b0e3be55f621 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082613 Sep 01 08:23:03.265656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 906/1838] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:03 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:03.724897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:03.725530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:03.732086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.732556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.732979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.733664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.734106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.734545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.800203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:03.806456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:03.807061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:03.808207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7a84566-9b5f-46f7-bfa2-24bb572f7f61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087075 Sep 01 08:23:03.808774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 933/1839] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:03 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:03.814584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.815074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.815521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.816222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:03.816811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:03.817086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:03.879436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:03.888021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3728a116-2eac-4f20-addf-410ff4d1cd71 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084846 Sep 01 08:23:03.888517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 907/1840] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:03 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:04.050005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:04.050663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:04.056681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.057154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.057582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.058293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.058748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.059723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.123544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:04.131654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:04.133090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:04.134186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c3c4e99c-d728-4e97-b543-e544979f8cba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088145 Sep 01 08:23:04.134771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 934/1841] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:04 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:04.176919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:04.177574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:04.183711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.184234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.184726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.185441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.185900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.186349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.256776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:04.265027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-957f1e28-94c5-43cd-9375-eb24deaa65ed tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.091889 Sep 01 08:23:04.265670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 908/1842] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:04 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:04.285030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:04.285638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:04.291699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.292722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.293207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.294849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.295636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.296389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.363374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:04.376439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-15fe2f06-deef-4e01-8acc-50d44eb303e2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094629 Sep 01 08:23:04.377586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 935/1843] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:04 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:04.829654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:04.830302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:04.836581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.837064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.837495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.838199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.838671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.839092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.906050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:04.909560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:04.910181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:04.914060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4f1cd772-382f-4a5a-997a-4703a82d6dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088235 Sep 01 08:23:04.915035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 909/1844] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:04 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:04.917488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.918005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.918603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.919353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:04.920393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:04.921060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:04.986445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:04.993993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7821344e-0d47-4294-bea5-a8dda3c8e929 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088767 Sep 01 08:23:04.994568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 936/1845] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:04 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:05.157474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:05.158006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:05.164190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.164674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.165108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:05.165810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.166284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.166716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:05.229300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:05.237616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:05.239065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:05.240161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1e227eed-51b3-4101-8b47-55f380eb4f32 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087302 Sep 01 08:23:05.240738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 910/1846] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:05 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:05.287267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:05.287898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:05.293745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.294212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.294675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:05.295354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.295945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.296366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:05.358695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:05.366272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a9a577b-a61f-484b-ba28-edde65d425ef tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082862 Sep 01 08:23:05.366838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 937/1847] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:05 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:05.398178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:05.398820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:05.405701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.406184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.406642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:05.407341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.407859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.408227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:05.469299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:05.476940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b795763c-b13d-43db-80e5-1c23d1d1b264 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082593 Sep 01 08:23:05.477492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 911/1848] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:05 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:05.939846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:05.940392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:05.949528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.950397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.950970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:05.952408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:05.953613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:05.954278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.014663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:06.015438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:06.021659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.022155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.022611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.022754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:06.023306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.023756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.024179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.030812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd53542b-72c4-4553-b38d-92eb627285ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.095519 Sep 01 08:23:06.031391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 938/1849] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:05 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:06.088588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:06.096350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b5a25eb7-a1fa-47bd-837e-4ff31af3e6c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086026 Sep 01 08:23:06.096916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 912/1850] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:06 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:06.264197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:06.264803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:06.270923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.271868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.271868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.272503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.272949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.273357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.342226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:06.358344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:06.361258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:06.363445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e506084b-8f8e-40c2-b03f-a2b096fc33f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.102996 Sep 01 08:23:06.364506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 939/1851] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:06 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:06.386492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:06.387131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:06.393114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.393591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.394025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.394737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.395189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.395612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.455330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:06.463232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ed7f198-edee-40b9-a190-702f118b4836 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080666 Sep 01 08:23:06.463790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 913/1852] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:06 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:06.496981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:06.498803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:06.505824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.506335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.506766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.507456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:06.507914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:06.508343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:06.568785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:06.576549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-87112579-15ae-4db7-9539-1edb2e998673 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083473 Sep 01 08:23:06.577111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 940/1853] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:06 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:07.063066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:07.064646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:07.070568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.071021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.071445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.072286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.072737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.073151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.117085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:07.117847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:07.124438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.125069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.125372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.126084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.126617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.127044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.163106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:07.173165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3878833-94d3-43fd-81c8-5c378208302b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.114609 Sep 01 08:23:07.174039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 914/1854] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:07 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:07.213375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:07.222602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ef7d264-af05-459b-b20e-3179343dfff3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.109241 Sep 01 08:23:07.223484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 941/1855] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:07 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:07.387848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:07.388492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:07.394676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.395151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.395577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.396270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.396711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.397123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.460903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:07.470060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:07.471516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:07.472627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-44bcf306-4b03-4461-8441-72428a7f38fb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089981 Sep 01 08:23:07.473180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 915/1856] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:07 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:07.484958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:07.485753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:07.491828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.492305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.492740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.493425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.493873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.494321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.496847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:07.554559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:07.562828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23acf242-ec65-4d41-8cf6-95bf7ac58d95 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082244 Sep 01 08:23:07.563227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 942/1857] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:07 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:07.599318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:07.600071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:07.606234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.606739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.607256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.607943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:07.608405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:07.608819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:07.669248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:07.676950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c580afb2-f8f4-4c86-ae35-6c91baed65fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082956 Sep 01 08:23:07.677499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 916/1858] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:07 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:08.195155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:08.195758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:08.202795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.203263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.203692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.204378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.204823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.205236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.245009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:08.245709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:08.253242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.253998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.254573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.255526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.256189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.256838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.287070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:08.294839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfb24a6d-d53b-46c6-910e-70f726071654 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.103478 Sep 01 08:23:08.295405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 943/1859] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:08 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:08.330882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:08.338838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-346025c4-3952-419b-afd0-dd4aac7bb098 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.097964 Sep 01 08:23:08.339417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 917/1860] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:08 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:08.496532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:08.497135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:08.503405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.503886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.504323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.505018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.505461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.505879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.569980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:08.578675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:08.580236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:08.581389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-271ef54c-59e6-4d70-89da-88c71edeb050 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089309 Sep 01 08:23:08.581980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 944/1861] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:08 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:23:08.584966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:08.585842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:08.592117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.592603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.593031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.593738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.594186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.594639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.655893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:08.663907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6dcfe9dd-425d-4c6d-adef-c4aecc86095a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083249 Sep 01 08:23:08.664468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 918/1862] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:08 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:08.697327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:08.697939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:08.703862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.704462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.705008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.705733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:08.706187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:08.706638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:08.768821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:08.776394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2919334-ac7c-41ad-8a5e-1963f631bc4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082971 Sep 01 08:23:08.776957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 945/1863] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:08 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:09.317312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:09.317935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:09.324177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.324667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.325102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.325811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.326272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.326702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.346602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:09.359510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:09.360109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:09.366835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.367321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.367756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.368461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.368909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.369332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.395222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:09.404079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a8275b7-4449-4084-8179-dc1f89999ce4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.091318 Sep 01 08:23:09.404675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 919/1864] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:09 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:09.435538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:09.444431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-91c87a74-0707-4b9e-845d-9743ca622f9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088619 Sep 01 08:23:09.445016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 946/1865] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:09 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:09.607108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:09.607627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:09.615653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.616155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.616699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.617944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.618560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.619081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.687456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:09.687710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:09.688663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:09.697943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.698851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.699627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.700835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.701481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:09.701727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.702552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.704554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:09.706477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-50441503-45d0-4b74-be54-bd5dc714b15f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.103071 Sep 01 08:23:09.707405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 920/1866] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:09 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:09.783180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:09.790850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5fcf2740-fbbd-4d8c-bf1b-043eabc74eb9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.109672 Sep 01 08:23:09.791413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 947/1867] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:09 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:09.796761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:09.797365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:09.803879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.804353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.804778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.805453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:09.805895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:09.806332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:09.868931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:09.877199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-775df97c-2fd6-4d83-8f38-4deb41bbb75e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084155 Sep 01 08:23:09.877770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 921/1868] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:09 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:10.427156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:10.427769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:10.433897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.434414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.434849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.435538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.435983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.436398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.466655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:10.467606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:10.474803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.474803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.475474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.476267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.476800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.477329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.505771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:10.512184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f7020e8-d225-4752-84e5-4df00b025003 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089299 Sep 01 08:23:10.525323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 948/1869] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:10 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:10.556090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:10.567141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8cf01098-4fba-4657-ae2e-68484a95f4e2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.104162 Sep 01 08:23:10.568484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 922/1870] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:10 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:10.744197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:10.744826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:10.750663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.751141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.751581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.752271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.752714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.753139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.816292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:10.817393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:10.828431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.829004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.830468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.831476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:10.831640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.832020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.832659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.840465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:10.841886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:10.843024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce280889-79cb-49b2-bfee-8f228470d651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.102931 Sep 01 08:23:10.843752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 949/1871] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:10 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:10.896713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:10.897795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:10.898503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:10.904355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.904605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1eca942e-e95a-4748-aa34-66b600a518e4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.096169 Sep 01 08:23:10.904826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.905170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 923/1872] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:10 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:10.905343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.905928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:10.906395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:10.906813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:10.968145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:10.975866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-454c9eef-140c-4b05-8d60-0013766194fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081711 Sep 01 08:23:10.976418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 950/1873] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:10 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:11.539124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:11.539739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:11.545784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.546283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.546722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.547416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.548615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.549084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.591186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:11.591770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:11.593692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:11.599460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.599968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.600394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.601078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.601518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.601930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.621766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:11.629935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-63b4ceb7-f4d5-4e16-9c80-6929baccfd1d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094715 Sep 01 08:23:11.631013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 924/1874] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:11 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:11.668775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:11.677567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b235e303-9ed8-41d8-bf7e-9daf74e24d30 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090325 Sep 01 08:23:11.678141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 951/1875] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:11 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:11.867349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:11.868217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:11.874464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.874954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.875384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.876163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.876608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.877020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.925272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:11.926150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:11.932751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.933579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.934194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.934917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:11.935544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:11.935971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:11.944715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:11.957188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:11.958742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:11.959880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-545e5995-1d08-4ead-88af-be7b1b6ba178 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.098480 Sep 01 08:23:11.961915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 925/1876] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:11 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:11.997823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:11.998477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:12.005607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.006184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.006781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:12.007688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.008097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.008636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:12.016999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:12.026641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0bbf4042-ebe1-4c33-b37d-6ddeb17e6022 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.105100 Sep 01 08:23:12.027309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 952/1877] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:11 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:12.080093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:12.088165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ac789e4e-0856-47f6-bf05-5973832f6a1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094358 Sep 01 08:23:12.089195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 926/1878] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:11 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:12.650557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:12.651126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:12.657041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.657518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.657944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:12.658841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.659290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.659711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:12.699994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:12.700649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:12.706747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.707226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.707654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:12.708478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.708925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.709343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:12.724628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:12.732489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44b81a61-5ad6-4d83-81f0-6367450c7fc8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085885 Sep 01 08:23:12.733063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 953/1879] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:12 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:12.774113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:12.782198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a972d7e5-ec2a-4270-9b6c-e7814c2ea96b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086549 Sep 01 08:23:12.782833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 927/1880] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:12 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:12.985938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:12.986577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:12.993530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.994019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.994488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:12.995195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:12.995644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:12.996067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.048636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:13.049443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:13.061969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:13.065804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.067481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.067929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.068669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.069128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.069551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.073200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:13.075598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:13.077150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3e700947-0b20-4611-b37d-69a2bd753ef6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095193 Sep 01 08:23:13.077890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 954/1881] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:12 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:13.111335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:13.112007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:13.118559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.119056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.119489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.120195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.120637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.121050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.154354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:13.163444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec5cfd72-7793-407d-94a1-c6a0333d448d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.118567 Sep 01 08:23:13.174838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 928/1882] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:13 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:13.190123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:13.198886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8fd1d6c9-6dd2-422e-b5e9-12e54c28be47 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090972 Sep 01 08:23:13.199642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 955/1883] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:13 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:13.754910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:13.755591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:13.757593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:13.762990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.763474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.763909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.764634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.765084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.765505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.803462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:13.804299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:13.810400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.810911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.811322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.812288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:13.812767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:13.813352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:13.832400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:13.843588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57f03752-9e1d-4aaa-ae69-63e5623c3854 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.091810 Sep 01 08:23:13.844263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 929/1884] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:13 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:13.878833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:13.889053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a584388a-6ab4-423f-a473-c1e33b367c23 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090042 Sep 01 08:23:13.889767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 956/1885] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:13 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:14.117692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:14.118327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:14.124300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.124784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.125216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.125918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.126399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.126867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.186006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:14.186864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:14.195984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.196476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.196911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.197624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.198076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.198528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.211681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:14.224929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:14.226607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:14.227783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e55109d-4904-4170-8d58-c3bf78df8e9e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.113898 Sep 01 08:23:14.234327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 930/1886] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:14 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:14.234327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:14.234639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:14.246951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.247431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.247859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.248606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.249054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.249468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.292755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:14.303347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-caa2904d-3a08-42fc-8e49-92f865e75529 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.121547 Sep 01 08:23:14.303929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 957/1887] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:14 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:14.323119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:14.333495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd75dfcf-1973-4ebc-bb14-2496eb92bcf4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.101096 Sep 01 08:23:14.334072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 931/1888] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:14 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:14.866105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:14.866901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:14.873709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.874197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.874658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.875362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.875958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.876669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.911321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:14.915217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:14.930155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.930677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.931112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.931818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:14.932276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:14.932690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:14.957134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:14.959656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:14.968285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1f0043c0-509c-4108-aa27-a1fd11cf9c47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.107033 Sep 01 08:23:14.969567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 958/1889] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:14 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:15.005679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:15.014543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee14526e-93d1-4a51-ade0-058463ebec24 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.107606 Sep 01 08:23:15.019789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 932/1890] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:14 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:15.252416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:15.253095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:15.260019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:15.260506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:15.261125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:15.261841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:15.262319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:15.262760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:15.325832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:15.326800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:15.338540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:15.339280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:15.339730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:15.340455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:15.340906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:15.341327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:15.352086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:15.360997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:15.364033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:15.365040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d75f01aa-736e-4991-b239-8b047f6978a2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.116723 Sep 01 08:23:15.365638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 959/1891] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:15 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:23:15.370203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:15.370851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:15.378613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:15.379109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:15.379553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:15.380259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:15.380715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:15.381141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:15.454402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:15.467667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1afe226e-dd0e-48dd-a190-ebd39edd1624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.145528 Sep 01 08:23:15.469397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 933/1892] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:15 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:15.485278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:15.497848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2afbd74b-74f1-4487-9d41-e4dbde48e809 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.130903 Sep 01 08:23:15.498696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 960/1893] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:15 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:15.999166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:16.000102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:16.010031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.010884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.011542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.012731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.013519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.014246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.044274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:16.045787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:16.055414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.056189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.056882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.058021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.058835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.059549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.102582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:16.115030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91720f77-edae-4fb4-bd93-8ae16ed699cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.119331 Sep 01 08:23:16.115030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 934/1894] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:15 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:16.141319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:16.153892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4c47b92b-b82c-4f33-9038-6abc78b7d441 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.115714 Sep 01 08:23:16.154694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 961/1895] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:16 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:16.395254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:16.396257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:16.406506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.407498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.408884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.410622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.411402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.412105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.488012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:16.491311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:16.492692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:16.496967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:16.498704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:16.499295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.499963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.500130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f89f79e6-cdc5-42b1-aebf-ff62e5d597b5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.110769 Sep 01 08:23:16.506386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 935/1896] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:16 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:16.506776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.507906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.508665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.509867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.522023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:16.522023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:16.534149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.534768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.535324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.536030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:16.536514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:16.536929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:16.541941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:16.612892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:16.625942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65626383-9acb-4bd2-bf8c-6801acb54f51 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.139637 Sep 01 08:23:16.626843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 962/1897] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:16 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:16.634464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:16.644860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a91e227-f194-4ad9-90f0-7fd64e24f4ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.127905 Sep 01 08:23:16.645690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 936/1898] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:16 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:17.150095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:17.150769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:17.156749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.157259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.157689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.159005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.159451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.159872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.175776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:17.176482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:17.182673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.183150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.183583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.184272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.184717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.185134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.224522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:17.232398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3037e5e-456b-4a6c-bb29-05b582243b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086278 Sep 01 08:23:17.232978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 963/1899] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:17 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:17.249946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:17.257955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d3b02d88-8265-473f-8880-62681e39d2ec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086095 Sep 01 08:23:17.258563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 937/1900] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:17 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:17.526932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:17.528550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:17.541215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.542185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.543066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.544783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.545604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.546355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.623042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:17.632905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:17.634383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:17.635512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea3a2199-b818-43d4-9a1f-850710b31d20 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.114821 Sep 01 08:23:17.636074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 964/1901] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:17 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:17.649863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:17.650754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:17.657298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.657768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.658326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.659095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.659541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.659954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.667879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:17.668498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:17.674850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.675341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.675778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.676500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:17.676949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:17.677372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:17.736007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:17.745177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93a9ac10-9497-4a26-92ad-b3d4b3cad2e3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.099663 Sep 01 08:23:17.745769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 938/1902] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:17 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:17.756762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:17.764795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1a8bf72b-7934-4d67-bcc5-fd1e165217d2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.100680 Sep 01 08:23:17.765984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 965/1903] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:17 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:18.256384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:18.257061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:18.264513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.264513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.264899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.265613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.266052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.266505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.280550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:18.281844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:18.289782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.290294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.290993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.292153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.292871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.293485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.352939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:18.365617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4106be71-4db0-44b4-8d7f-5159b4b97075 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.113164 Sep 01 08:23:18.366522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 939/1904] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:18 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:18.384988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:18.397472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c30f2ac1-1359-411a-a03b-35ebb6d41a1b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.120621 Sep 01 08:23:18.398531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 966/1905] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:18 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:18.659605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:18.660232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:18.666973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.667463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.667902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.668641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.669118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.669570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.741511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:18.750246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:18.751714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:18.752844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-51cec8b4-d318-4901-8f0d-a25600012c9d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.097898 Sep 01 08:23:18.753411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 940/1906] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:18 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:18.776855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:18.777473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:18.784965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.785459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.785967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.786713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.787163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.787645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.790122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:18.790878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:18.797059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.797545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.798021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.798834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:18.799382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:18.799924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:18.869057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:18.877694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6db57793-0f59-4141-b52e-567cdd2b5e04 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.104761 Sep 01 08:23:18.878302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 967/1907] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:18 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:18.890416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:18.899412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9f0e3fe4-db77-47d7-9e54-c698100994e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.116448 Sep 01 08:23:18.899989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 941/1908] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:18 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:19.387261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:19.387964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:19.394740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.395226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.395655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.396347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.396997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.397416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.426105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:19.427369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:19.437386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.438057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.439199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.440934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.441767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.442372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.468407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:19.478420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e62c4cf7-5a20-404a-85d9-32fab3fbeb4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.095089 Sep 01 08:23:19.479212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 968/1909] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:19 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:19.511599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:19.519684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9ff0296-a193-45b6-8af3-22e30a4bbca5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.099011 Sep 01 08:23:19.520258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 942/1910] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:19 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:19.775914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:19.776638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:19.784256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.785050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.785757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.786785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.787335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.787868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.873706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:19.885475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:19.887694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:19.889735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5348a3c5-edcf-4f6d-b5cc-d38c84dd0f2e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.117983 Sep 01 08:23:19.890969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 969/1911] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:19 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:23:19.912523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:19.913149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:19.921451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:19.922064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:19.930012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.930519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.930968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.931682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.932130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.932546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.933317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.934390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.935487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:19.937742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:19.939142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:19.940726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:20.033746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:20.043291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a21c476d-e0b1-42c2-a307-3f454b298349 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.125579 Sep 01 08:23:20.043896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 970/1912] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:19 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:20.065182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:20.075608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28df112b-f97e-4553-97b3-9c0c24a68448 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.169515 Sep 01 08:23:20.076304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 943/1913] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:19 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:20.499909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:20.500519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:20.507382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:20.508233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:20.508570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:20.509385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:20.509878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:20.510368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:20.540725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:20.542086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:20.548504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:20.549616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:20.550347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:20.551229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:20.551775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:20.552289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:20.608364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:20.617967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-08aec1c1-1a3b-42b5-a95b-3c710e419a84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.121821 Sep 01 08:23:20.630783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 971/1914] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:20 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:20.641226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:20.649621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eeb0ec85-fae5-4b4c-bcfc-1a27eb920f54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.113408 Sep 01 08:23:20.650418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 944/1915] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:20 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:20.921709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:20.922993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:20.933796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:20.934491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:20.935159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:20.935879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:20.936330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:20.936754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.006856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:21.016585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:21.018615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:21.020177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bffedf24-1923-410f-9ea6-faf42e0a20cb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.103957 Sep 01 08:23:21.020773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 972/1916] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:20 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:21.077099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:21.077796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:21.085870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.086387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.086830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.087542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.087987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.088412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.103321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:21.104332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:21.112417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.113423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.114090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.115143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.115803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.116226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.180116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:21.188626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8cb461fc-a8f4-49f7-bdea-3e261e5965d5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.115401 Sep 01 08:23:21.190146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 945/1917] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:21 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:21.228694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:21.237789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0e750e0c-4693-4bf8-98a8-e84c43396cd9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.141348 Sep 01 08:23:21.238412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 973/1918] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:21 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:21.639976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:21.640617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:21.647700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.648190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.648623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.649320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.649764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.650185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.672924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:21.674775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:21.681911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.682423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.682855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.683580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:21.684029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:21.685139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:21.760486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:21.774067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1c80a141-04e7-4722-90a8-b9b25f946e75 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.137306 Sep 01 08:23:21.774714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:21.775306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 946/1919] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:21 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:21.792337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-36798da1-ae52-4985-a39a-faaf10bc27a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.122401 Sep 01 08:23:21.793344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 974/1920] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:21 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:22.047434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:22.048460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:22.055844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.056331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.056750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.057451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.057900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.058347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.138045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:22.149450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:22.150990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:22.152120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d75fad5d-506d-4d5e-96e7-a9cf7ab92ad4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.111671 Sep 01 08:23:22.152970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 947/1921] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:22 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:23:22.208935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:22.209554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:22.216011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.216559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.217003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.217756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.218202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.218664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.238326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:22.259668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:22.261392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:22.270097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.271526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.272662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.273268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.274058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.274713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.524733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:22.540275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c9894ed4-ec5c-4394-af3c-90d769afc4ae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.334432 Sep 01 08:23:22.548389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:22.554936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 975/1922] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:22 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:22.566577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-45620dd2-93b8-45df-84b8-0fec9b62657b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.310218 Sep 01 08:23:22.567035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 948/1923] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:22 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:22.800342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:22.801521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:22.811130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.811962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.812554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.813656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.814168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.815311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.817453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:22.818789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:22.825717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.826199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.827043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.827966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:22.828415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:22.829018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:22.897823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:22.912590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ffe45af1-e5ed-47f7-ad57-56c6a9f6c779 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.120750 Sep 01 08:23:22.914320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 976/1924] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:22 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:22.929590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:22.941025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-122a4e21-71e6-4d57-a240-3acbcf219bb8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.129796 Sep 01 08:23:22.941738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 949/1925] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:22 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:23.176546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:23.177141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:23.184483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.184974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.185407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.186098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.186584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.187001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.254486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:23.263563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:23.265099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:23.266887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d84e803-e9dd-4191-a70c-e12186b01020 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094754 Sep 01 08:23:23.267461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 977/1926] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:23 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:23.573255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:23.573895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:23.580200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.580787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.581226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.581936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.582447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.582869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.589594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:23.590404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:23.598064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.598664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.599096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.599831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.600405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.600820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.655268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:23.664300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf2cb975-2870-4948-b8d0-db1cd1c4364c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094919 Sep 01 08:23:23.664884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 950/1927] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:23 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:23.676980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:23.684937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93b78990-7d9f-44c0-8228-34d51eda5d0d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.099377 Sep 01 08:23:23.685510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 978/1928] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:23 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:23.939094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:23.940045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:23.946596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.947079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.947513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.948279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.948724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.949142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.963614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:23.964221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:23.970164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.971336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.971820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:23.972555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:23.973123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:23.973553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:24.024804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:24.039774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f24599e-ef10-4cac-b144-dd36752e6b26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.104247 Sep 01 08:23:24.040813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 951/1929] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:23 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:24.053636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:24.061900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d93b0edd-8994-410a-b9a9-e32cd6312c54 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.102257 Sep 01 08:23:24.062533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 979/1930] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:23 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:24.290745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:24.291477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:24.299330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:24.300305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:24.300820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:24.301951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:24.302529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:24.303071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:24.382185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:24.386082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:24.394597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:24.396536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:24.397828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f9bb638-592b-4175-9301-7d1dc408ae0b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.111616 Sep 01 08:23:24.398786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 952/1931] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:24 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:24.685645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:24.686247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:24.692328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:24.692811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:24.693241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:24.693971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:24.694458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:24.694880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:24.709110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:24.709717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:24.716546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:24.717024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:24.717447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:24.718146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:24.718631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:24.719044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:24.771746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:24.780164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fa7d9079-f2f0-437a-95b2-36ca76708f69 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.098052 Sep 01 08:23:24.780739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 980/1932] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:24 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:24.793558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:24.802766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3d23ebda-045a-40cd-8642-7c9e6c5a64db tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.098235 Sep 01 08:23:24.803358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 953/1933] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:24 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:25.066886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:25.067497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:25.073834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.074353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.074777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.075470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.075914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.076333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.082916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:25.083755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:25.091771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.092109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.092720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.093425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.093867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.094425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.152580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:25.161609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cef99809-5d29-4956-8e7d-b6e5a5adb27f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.099009 Sep 01 08:23:25.162223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 981/1934] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:25 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:25.176640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:25.185742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a570429-df5d-48b2-b3b9-d44de3fc900e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.107226 Sep 01 08:23:25.186344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 954/1935] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:25 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:25.427348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:25.427971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:25.434148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.434680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.435115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.435806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.436248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.436700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.498309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:25.506497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:25.507917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:25.509002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9e460ef5-31fc-4d80-94bd-1dfd1e1ec21a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086672 Sep 01 08:23:25.509551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 982/1936] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:25 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:25.800849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:25.801517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:25.807981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.808461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.808896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.809883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.810370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.810795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.831348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:25.831966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:25.838576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.839058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.839489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.840183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:25.840635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:25.841055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:25.876462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:25.885244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-429662ba-1585-4ca9-9093-cb751d08d6cb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088497 Sep 01 08:23:25.885860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 955/1937] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:25 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:25.906692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:25.917078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40ba934b-da2d-42c0-b921-5fe1fd77a22b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090751 Sep 01 08:23:25.917661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 983/1938] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:25 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:26.195000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:26.195610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:26.201477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.201952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.202413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.203097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.203539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.203956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.207849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:26.208470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:26.214947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.215488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.215919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.216616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.217065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.217486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.277729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:26.288131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3c51f652-5182-469e-88aa-48e896560605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.095220 Sep 01 08:23:26.288131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 956/1939] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:26 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:26.297222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:26.305331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-840c2b88-a8cf-41f0-8271-3d097e7b5896 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.101898 Sep 01 08:23:26.305908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 984/1940] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:26 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:26.531953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:26.532561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:26.539118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.539599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.540032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.540727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.541174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.541590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.604935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:26.613016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:26.614481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:26.615570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-63755a14-2d0c-4f12-9507-ca16c6d762b0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087516 Sep 01 08:23:26.616122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 957/1941] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:26 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:26.906504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:26.907109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:26.913109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.913588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.914019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.914725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.915174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.915593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.937976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:26.938600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:26.945263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.945741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.946172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.946892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:26.947335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:26.947751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:26.978215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:26.986689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-71d9e17e-9b13-4182-9162-2bbf3bae951d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083372 Sep 01 08:23:26.987306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 985/1942] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:26 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:27.011245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:27.020417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9120e32-4a07-4772-8064-12c9b92f6831 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086107 Sep 01 08:23:27.020998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 958/1943] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:26 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:27.307108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:27.307716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:27.313775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:27.314331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:27.314790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:27.315465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:27.315907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:27.316321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:27.326158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:27.326795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:27.332891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:27.333376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:27.333801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:27.334547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:27.334961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:27.335633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:27.385657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:27.393659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7265a66-aaa6-4607-bfff-32c6029e5cf8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090325 Sep 01 08:23:27.394237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 986/1944] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:27 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:27.408282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:27.416285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a45beef3-9e8f-4b1d-bdf8-f3c6f98e4dd0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.093774 Sep 01 08:23:27.416854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 959/1945] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:27 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:27.637686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:27.638314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:27.645043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:27.645681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:27.646084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:27.646841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:27.647335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:27.647714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:27.714402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:27.723298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:27.724727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:27.727130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-98bde5bc-635c-4215-ae38-60dcf3e87f7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093234 Sep 01 08:23:27.727693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 987/1946] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:27 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:28.006404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:28.007039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:28.013285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.013756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.014183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.014884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.015328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.015740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.040962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:28.041566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:28.047543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.048020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.048499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.049709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.050157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.050606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.075940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:28.083936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-97146905-231d-4a3b-bc10-dd78013135ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081425 Sep 01 08:23:28.084564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 960/1947] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:28 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:28.112164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:28.123029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e350309e-7aae-4ab2-832b-7cb5b3a46225 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085806 Sep 01 08:23:28.123618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 988/1948] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:28 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:28.414816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:28.415351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:28.421151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.421624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.422050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.422745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.423193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.423649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.438316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:28.439311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:28.446353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.446983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.447472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.448119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.448570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.448993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.488613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:28.497811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2394f837-69d3-40a9-8399-0ae50d11b880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086746 Sep 01 08:23:28.498420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 961/1949] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:28 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:28.523928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:28.531611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0f3bd5b-14da-4a8c-939b-988a62a6261d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.097076 Sep 01 08:23:28.532187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 989/1950] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:28 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:28.749190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:28.749711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:28.755820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.756295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.756734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.757424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:28.757865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:28.758310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:28.820041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:28.827934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:28.829349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:28.830480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5716de82-93fe-40e2-abcd-25293d370748 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085307 Sep 01 08:23:28.831035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 962/1951] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:28 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:29.104887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:29.105484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:29.111403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.111873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.112297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.112970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.113412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.113830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.144468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:29.145088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:29.151281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.151762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.152196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.152888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.153356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.153755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.174742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:29.183535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9d1e420-639f-484d-9668-d83148396001 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082400 Sep 01 08:23:29.184115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 990/1952] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:29 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:29.219228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:29.228776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-66571ea8-08cb-47ed-bd4f-de7639e3e1b7 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087531 Sep 01 08:23:29.229355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 963/1953] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:29 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:29.519589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:29.520199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:29.526123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.526628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.527058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.527748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.528186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.528606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.552296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:29.553004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:29.559040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.559527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.559960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.560660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.561103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.561521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.594015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:29.602695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7f438c9b-6d91-4ecc-8ec6-6c40fd67d41c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087422 Sep 01 08:23:29.603273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 991/1954] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:29 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:29.625007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:29.633482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-63889f4b-ef5a-4c8d-952b-8dd8349a5cb1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085164 Sep 01 08:23:29.637159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 964/1955] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:29 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:29.852954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:29.853564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:29.859562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.860039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.860468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.861672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:29.862122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:29.862573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:29.865491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:29.925899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:29.934078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:29.935541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:29.936637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2af263a6-f844-4607-a7fd-1ed80be67a7a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087707 Sep 01 08:23:29.937197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 992/1956] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:29 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:30.204519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:30.205171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:30.211663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.212144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.212570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.213251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.213691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.214101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.248956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:30.249524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:30.255593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.256072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.256505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.257200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.257649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.258069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.276816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:30.285195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d2463394-379d-4c9f-ac09-df2628f5c139 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084525 Sep 01 08:23:30.285772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 965/1957] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:30 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:30.319755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:30.327619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aac1adba-c4c5-46f6-99f1-98b0e8c3ac28 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082206 Sep 01 08:23:30.328438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 993/1958] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:30 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:30.622853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:30.623482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:30.629601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.630078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.630533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.631211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.631652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.632068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.655574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:30.656294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:30.663112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.663593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.664023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.664731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.665181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.665607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.694808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:30.703478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-068c481f-a66d-4660-9332-db9c136497df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084327 Sep 01 08:23:30.710352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 966/1959] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:30 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:30.729147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:30.739979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d3661e44-851b-4f27-a6ee-3a33fc1605bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088149 Sep 01 08:23:30.741027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 994/1960] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:30 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:30.959728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:30.960596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:30.966890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.967375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.967815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:30.968513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:30.968965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:30.969389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.055231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:31.060784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:31.062220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:31.063351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-17ad55c0-c9a6-45ad-9154-2ccc0cf34e96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.108254 Sep 01 08:23:31.064496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 967/1961] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:30 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:31.306452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:31.307079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:31.313252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.313891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.314570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.315260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.315707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.316148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.351799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:31.352536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:31.359485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.360158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.360687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.361379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.362177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.362622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.377993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:31.386901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-492e7e1f-f16b-4a11-aefc-a95664197351 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084485 Sep 01 08:23:31.387472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 995/1962] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:31 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:31.426988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:31.434940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2496c5dd-e970-440c-86a2-f52f456f8d1f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.089717 Sep 01 08:23:31.435514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 968/1963] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:31 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:31.728470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:31.729009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:31.735026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.735502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.736592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.737283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.737725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.738171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.763094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:31.763800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:31.770708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.771200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.771637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.772328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:31.772843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:31.773196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:31.793040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:31.805792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:31.813714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0848321-f57c-4c7b-b237-7dffc0db47b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090532 Sep 01 08:23:31.814835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 996/1964] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:31 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:31.842672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:31.850247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-64e4ec7b-a21b-485d-8fe9-0e7253b3f2a3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.092796 Sep 01 08:23:31.851006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 969/1965] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:31 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:32.086582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:32.087176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:32.093155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.093636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.094069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.094804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.095384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.096113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.156978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:32.165323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:32.166762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:32.167838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13828d4c-1c7f-4225-8d52-d4fc0416451d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085491 Sep 01 08:23:32.168390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 997/1966] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:32 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:32.415380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:32.416503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:32.429724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.430443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.431014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.432025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.432640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.433177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.455613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:32.456652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:32.462844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.463381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.463850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.464544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.464999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.465434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.498472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:32.506721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-808b4cdf-6ee2-4005-a2e3-92c1042db6aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.101684 Sep 01 08:23:32.507483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 970/1967] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:32 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:32.527015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:32.535893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02648df3-8676-408e-9254-6ea5a49dd199 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084213 Sep 01 08:23:32.536517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 998/1968] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:32 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:32.835705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:32.836313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:32.842247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.842998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.843617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.844836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.845910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.846536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.871218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:32.871815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:32.878420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.878988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.879324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.880025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:32.880467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:32.880883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:32.913713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:32.921950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7339d951-ba90-4f95-9fb7-65777dab1e38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090265 Sep 01 08:23:32.922573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 971/1969] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:32 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:32.947468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:32.955585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28b32502-5c90-47ff-84d6-4f0c27541048 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088998 Sep 01 08:23:32.956136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 999/1970] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:32 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:33.191078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:33.191599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:33.197848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.198357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.198788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.199488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.199935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.200357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.262799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:33.272944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:33.274417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:33.275514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5cca778e-887c-4d14-8430-21d5a3c9833e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089032 Sep 01 08:23:33.276065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 972/1971] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:33 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:33.527296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:33.527984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:33.534697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.535265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.535684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.536363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.536804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.537245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.556834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:33.557437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:33.563254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.563731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.564156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.564839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.565298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.565694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.599409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:33.607211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-456c4563-4de5-48b4-97b2-ee28ee8f408b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083753 Sep 01 08:23:33.607785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1000/1972] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:33 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:33.631909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:33.640196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ce0205b3-4a71-4acf-acc0-cb8bb054aa6b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087100 Sep 01 08:23:33.640774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 973/1973] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:33 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:33.944755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:33.945365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:33.947236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:33.952539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.953017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.953445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.954132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.954636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.955059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.976358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:33.976962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:33.983218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.983699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.984133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:33.984826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:33.985273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:33.985795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:34.018606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:34.026717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e01670c8-47ae-4065-9e78-e7920ff8196c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085703 Sep 01 08:23:34.027296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1001/1974] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:33 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:34.049611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:34.057489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6cc13e71-85e0-4bfd-996f-af10cbeb6711 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084867 Sep 01 08:23:34.058060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 974/1975] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:33 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:34.298865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:34.299514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:34.305532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:34.306015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:34.306481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:34.307176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:34.307626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:34.308035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:34.368253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:34.376285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:34.377749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:34.378893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-017832f4-cda0-49c6-b5d2-ac271ceaae26 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084560 Sep 01 08:23:34.379444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1002/1976] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:34 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:34.627803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:34.628323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:34.634199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:34.634699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:34.635129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:34.635804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:34.636250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:34.636692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:34.663055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:34.663656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:34.669539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:34.670010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:34.670591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:34.671275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:34.671721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:34.672135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:34.699737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:34.708100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c8e739ef-257f-4bdd-9fb9-2d971d5dd5a4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084262 Sep 01 08:23:34.708662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 975/1977] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:34 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:34.733072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:34.742106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-de08e051-8367-43aa-911d-9c5c8a517a48 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082667 Sep 01 08:23:34.742718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1003/1978] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:34 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:35.049207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:35.049794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:35.056077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.056552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.057127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.057949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.058428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.058850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.078976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:35.080544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:35.086806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.087284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.087718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.088414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.088865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.089288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.125729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:35.134232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9abddf70-16a0-4a02-b5f7-7b9f22f08e65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089333 Sep 01 08:23:35.134846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 976/1979] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:35 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:35.152093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:35.160564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd6d54f4-da79-4711-aba5-5727416ecb59 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085411 Sep 01 08:23:35.161133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1004/1980] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:35 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:35.401056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:35.401689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:35.408595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.409087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.409518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.410218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.410704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.411126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.474142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:35.482189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:35.483622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:35.484692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19a5cd65-7f63-4e9e-a167-f3e480b5e1ba tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087554 Sep 01 08:23:35.485240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 977/1981] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:35 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:35.728558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:35.729084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:35.735161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.735637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.736076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.736829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.737279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.737697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.767025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:35.768401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:35.774584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.775058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.775486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.776168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:35.776610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:35.777021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:35.806388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:35.814140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a8a15032-10b5-4378-99f1-7dce104a1ed1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089501 Sep 01 08:23:35.815281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1005/1982] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:35 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:35.838052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:35.846317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d196f57c-67f8-4f81-ae67-a36c58955be2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084993 Sep 01 08:23:35.847114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 978/1983] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:35 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:36.155894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:36.156500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:36.163627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.164127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.164547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.165242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.165697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.166120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.181180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:36.181776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:36.183664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:36.189848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.190211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.190792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.191567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.192024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.192474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.232098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:36.241374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5aaee439-d99c-4dc7-b279-a3c911e8db14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089182 Sep 01 08:23:36.241961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1006/1984] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:36 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:36.260292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:36.267938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e31dd5f-0fa3-4208-ae56-423263ee3ab4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090519 Sep 01 08:23:36.268597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 979/1985] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:36 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:36.507751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:36.508785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:36.515223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.516362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.516981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.518542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.519374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.520302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.585794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:36.594229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:36.596245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:36.597493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-675a50d2-376d-4eef-b17c-0e4fc6a078cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094113 Sep 01 08:23:36.598051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1007/1986] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:36 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:36.835630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:36.836431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:36.844125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.844600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.845028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.845709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.846157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.846603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.871272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:36.871906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:36.879052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.879675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.880160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.881006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:36.881508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:36.881998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:36.910963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:36.918904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31c81fc0-6269-4e08-8c66-f2d56072ea22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.087543 Sep 01 08:23:36.919466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 980/1987] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:36 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:36.954824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:36.957145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:36.964450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0986d93e-4985-494e-8835-1c3e4ea0a222 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.099695 Sep 01 08:23:36.965022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1008/1988] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:36 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:37.261058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:37.261607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:37.267492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.267971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.268397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.269078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.269523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.269942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.289594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:37.290204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:37.297387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.297861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.298307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.299684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.300284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.300705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.337630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:37.346493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19ebdd12-e489-4beb-8315-aff24cd7dc81 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088632 Sep 01 08:23:37.347053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 981/1989] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:37 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:37.364030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:37.371737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-996094ab-7da3-42be-a54f-b6426f984382 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086315 Sep 01 08:23:37.372290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1009/1990] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:37 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:37.621254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:37.621867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:37.628731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.629214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.629644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.630399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.630851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.631267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.695322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:37.703229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:37.704638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:37.705935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-df1e34bc-c181-4ebd-b943-9d81487818d5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089078 Sep 01 08:23:37.706522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 982/1991] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:37 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:37.942708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:37.943651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:37.951065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.951620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.952176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.952974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:37.953517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:37.953999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:37.991400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:37.993494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:38.011258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.012257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.013212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.014316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.014863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.015376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.026094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:38.034270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ad221bd3-3e53-4366-b374-9de86fec002d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.097662 Sep 01 08:23:38.035123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1010/1992] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:37 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:38.086093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:38.094623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93d2e00d-1a9d-4913-9be7-6647516a74f5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.112242 Sep 01 08:23:38.095198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 983/1993] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:37 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:38.367213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:38.367744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:38.373960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.374495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.374945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.375639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.376084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.376508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.392973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:38.393842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:38.399753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.400235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.400669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.401369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.401825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.402245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.458184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:38.466585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3eaa679f-b027-4b33-b3a1-71aa17e16045 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.103276 Sep 01 08:23:38.467421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1011/1994] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:38 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:38.481496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:38.489698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8cc7db6c-a681-440c-b4a8-b7ecca582f7e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.101251 Sep 01 08:23:38.490283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 984/1995] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:38 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:38.729658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:38.730184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:38.736905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.737402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.737835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.738552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:38.739005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:38.739427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:38.800258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:38.808276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:38.809709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:38.810865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-74f7f37c-d2d5-464b-a7af-154446f5356a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085250 Sep 01 08:23:38.811416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1012/1996] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:38 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:39.054464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:39.055067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:39.060928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.061398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.061824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.063288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.063288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.063515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.115286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:39.115993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:39.122066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.122649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.123077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.123766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.124266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.124613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.126715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:39.134365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8f51a39-dd03-49fa-85d4-93889908d681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083738 Sep 01 08:23:39.134926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 985/1997] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:39 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:39.185736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:39.194432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db55b559-7a78-4db2-97d8-515cec967180 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083148 Sep 01 08:23:39.195011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1013/1998] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:39 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:39.487841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:39.488453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:39.494505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.494983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.495412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.496100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.496549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.496972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.500948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:39.511106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:39.511733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:39.517713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.518451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.518886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.519582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.520025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.520490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.563824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:39.572119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-39c6ec80-e45b-4014-9d45-88f5ad3b9e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088645 Sep 01 08:23:39.572949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 986/1999] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:39 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:39.592056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:39.600463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-12166c4c-37e4-4bc7-94e6-7389d0c95262 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.093317 Sep 01 08:23:39.601016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1014/2000] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:39 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:39.833434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:39.834043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:39.840588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.841074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.841521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.842217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:39.842698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:39.843121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:39.905625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:39.914205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:39.915671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:39.916795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-39776ad6-aa70-4d44-87a5-d15fbb0cf7f0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087452 Sep 01 08:23:39.917348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 987/2001] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:39 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:40.155200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:40.155734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:40.162391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.162869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.163298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.163978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.164422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.164849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.216016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:40.216636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:40.223434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.223921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.224353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.225051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.225497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.225966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.226090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:40.233874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b7da21f4-988d-425e-a2ed-c296b10b1353 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082560 Sep 01 08:23:40.234465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1015/2002] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:40 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:40.286198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:40.293894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1d85d217-fd00-46c1-af2f-e22acef02f27 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081912 Sep 01 08:23:40.300936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 988/2003] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:40 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:40.598097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:40.598822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:40.604753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.605232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.605656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.606361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.606803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.607217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.621270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:40.621870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:40.627990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.628470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.628893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.629582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.630018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.630460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.681079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:40.695509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-06473051-b93a-4d4f-847c-2680c5a21ff1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.101616 Sep 01 08:23:40.696557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1016/2004] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:40 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:40.700511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:40.708938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-08ef8c68-0895-4ac1-9b06-6717e5c9be07 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091771 Sep 01 08:23:40.709489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 989/2005] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:40 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:40.939412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:40.940093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:40.946089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.946596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.947027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:40.947743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:40.948189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:40.948609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.009738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:41.017727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:41.019172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:41.020250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-221db72c-8a4a-40f5-b0b0-282fe1bb2073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084866 Sep 01 08:23:41.020796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1017/2006] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:40 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:41.256118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:41.256642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:41.262647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.263125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.263556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.264237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.264685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.265106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.315470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:41.316076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:41.322058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.324253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.324394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.325017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.325289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:41.325461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.325875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.333929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b2fcc9cb-c645-4c4a-969c-ea48006c28ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082498 Sep 01 08:23:41.334534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 990/2007] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:41 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:41.387378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:41.395684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7db3d05d-5928-4025-ad93-4ce5e58d3d43 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084880 Sep 01 08:23:41.396231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1018/2008] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:41 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:41.717188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:41.717782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:41.726124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.726636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.727057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.727746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.728186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.728623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.729094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:41.729761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:41.736189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.737235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.737666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.738492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:41.738866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:41.739281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:41.817554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:41.819258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:41.825239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c55221e-d609-404c-b0d0-c34c6ee82f33 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.111889 Sep 01 08:23:41.825803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 991/2009] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:41 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:41.826944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-408b44a6-80ba-4889-a076-8264fb30b941 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.101641 Sep 01 08:23:41.827488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1019/2010] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:41 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:42.042872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:42.043477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:42.049402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.049876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.050328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.051014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.051458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.051873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.111683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:42.119782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:42.121238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:42.122357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-793b2faa-f6bc-4f40-8940-882a7b5dc5f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083369 Sep 01 08:23:42.122910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 992/2011] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:42 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:42.355262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:42.355895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:42.362130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.362636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.363060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.363736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.364204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.364621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.417455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:42.418070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:42.425243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.425801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.426236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.426979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.427432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.427849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.429859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:42.440392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a5955a00-7d26-45f3-9a79-735d388549a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088767 Sep 01 08:23:42.441153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1020/2012] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:42 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:42.497923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:42.506846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-54ce61d3-2cc4-4c23-b097-fa6c586755ce tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.093200 Sep 01 08:23:42.507418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 993/2013] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:42 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:42.847820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:42.848386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:42.848766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:42.848872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:42.854773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.854984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.855249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.855368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.855702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.855827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.856387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.856495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:42.856827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.856936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:42.857247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.857352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:42.929053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:42.936997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a4d838e-617c-4f16-897e-cbd26b69011f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.093060 Sep 01 08:23:42.937599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1021/2014] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:42 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:42.945899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:42.953464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-95c2a033-e77b-42b2-b125-1e34598aa13c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.109369 Sep 01 08:23:42.954045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 994/2015] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:42 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:43.145091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:43.145592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:43.151595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.152071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.152504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.153182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.153630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.154048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.214278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:43.222846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:43.224310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:43.225399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e12da091-412e-4606-942c-f68014833b13 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084452 Sep 01 08:23:43.225947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1022/2016] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:43 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:43.461703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:43.462339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:43.473370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.473848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.474307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.475017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.475477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.475901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.528195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:43.528914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:43.540742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.541414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.546536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.547578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.548144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.549206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.568364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:43.579135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8628bac1-5477-460b-bc19-8eb212f3f1b7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.121632 Sep 01 08:23:43.579837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 995/2017] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:43 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:43.624199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:43.634663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cdd02ec8-7207-4307-be58-bd8d5fa2e84b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.110252 Sep 01 08:23:43.635235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1023/2018] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:43 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:43.958615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:43.959279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:43.965496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.965979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.966457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.967160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.967613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.968073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.975296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:43.975929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:43.981962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.982479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.982904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:43.983597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:43.984043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:43.984482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:44.034069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:44.042167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-20547aed-d4fd-4b7b-bb6b-1d62a65155dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087436 Sep 01 08:23:44.042866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 996/2019] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:43 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:44.060047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:44.068710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-de1e00ba-f6b5-4525-bd71-e589139c58a9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.098144 Sep 01 08:23:44.069265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1024/2020] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:43 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:44.248335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:44.248855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:44.255329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:44.255812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:44.256242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:44.256922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:44.257368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:44.257817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:44.323380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:44.331706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:44.333146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:44.334249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-22914198-dc8d-4e4a-aa87-8740286787a7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089900 Sep 01 08:23:44.335096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 997/2021] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:44 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:44.600510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:44.601153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:44.607085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:44.607563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:44.608002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:44.608683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:44.609135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:44.609559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:44.624248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:44.655786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:44.656411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:44.662404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:44.662889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:44.663326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:44.664016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:44.664468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:44.664889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:44.671269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:44.678906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21ee163f-37af-4cc1-89b7-1e3663dd5a4f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082226 Sep 01 08:23:44.679969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1025/2022] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:44 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:44.724946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:44.732598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-30f55b13-0518-44b6-bd12-1183e0fc8673 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080601 Sep 01 08:23:44.733143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 998/2023] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:44 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:45.064642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:45.065453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:45.072022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.072503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.072931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.073629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.074248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.074712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.090012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:45.090791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:45.097434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.097918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.098977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.099110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.099541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.099946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.138603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:45.146968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9438696b-a848-4efe-9f3d-35c2cb204876 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087184 Sep 01 08:23:45.160362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1026/2024] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:45 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:45.168069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:45.176065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c1ff0ea3-c036-48b3-ae33-b6ee2bf9e772 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089971 Sep 01 08:23:45.176620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 999/2025] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:45 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:45.358819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:45.359341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:45.365871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.366417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.366879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.367565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.368015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.368435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.429442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:45.437813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:45.439936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:45.441188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-efa0f60c-d34e-42c6-b01e-cdf7cdd0ea15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088229 Sep 01 08:23:45.441740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1027/2026] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:45 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:45.700100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:45.700706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:45.707190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.707664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.708118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.708808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.709256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.709934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.752860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:45.753466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:45.759392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.759845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.760265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.760944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:45.761380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:45.761791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:45.773577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:45.781273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bab513c6-fd5e-42b1-a3af-24f11b0ce63f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084941 Sep 01 08:23:45.781986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1000/2027] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:45 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:45.822491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:45.830512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fc7a82af-2aee-48b3-b6ab-530735bb70f8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081436 Sep 01 08:23:45.831067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1028/2028] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:45 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:46.169311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:46.170147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:46.178394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.178880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.179309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.180004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.180447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.180866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.197089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:46.197696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:46.203642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.204119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.204664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.205543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.205993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.206465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.254763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:46.262733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2a00edd-ad31-4675-b949-83a594c7e1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.098060 Sep 01 08:23:46.263315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1001/2029] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:46 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:46.415395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:46.423799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-042eb22e-9f71-4330-baae-edba958d217e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.229894 Sep 01 08:23:46.424348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1029/2030] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:46 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:46.464268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:46.464860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:46.470933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.471417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.471845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.472530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.472968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.473385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.535068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:46.538276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:46.544107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:46.545528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:46.546645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf1a14dd-b6bc-4b83-a380-f610d151b78e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086291 Sep 01 08:23:46.547189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1002/2031] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:46 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:23:46.802987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:46.803596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:46.810204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.810711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.811141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.811841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.812288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.812709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.852148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:46.852742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:46.858685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.859162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.859586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.860266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:46.860761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:46.861674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:46.873126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:46.880823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-551e4533-5526-4933-a6bf-ad3a74972075 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082544 Sep 01 08:23:46.881392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1030/2032] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:46 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:46.921672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:46.930197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e24f8fbd-5cfb-4f03-832b-806976b4c5d1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081970 Sep 01 08:23:46.930723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1003/2033] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:46 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:47.285540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:47.286148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:47.292178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.292652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.293079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.293770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.294211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.294652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.358053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:47.366196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-425c4c0c-1240-4031-bcb3-f0330351b97e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084556 Sep 01 08:23:47.366774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1031/2034] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:47 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:47.451933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:47.451933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:47.451933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.451933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.452797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.452797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.452797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.453056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.514709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:47.522667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3d51a4bb-1535-4d42-bbea-9dc5151d3b70 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082517 Sep 01 08:23:47.523243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1004/2035] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:47 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:47.569086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:47.569616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:47.575700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.576181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.576620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.577310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.577776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.578182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.638999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:47.647401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:47.648810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:47.649883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-677d6729-9213-4002-9db9-1011090f9a9b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084795 Sep 01 08:23:47.650728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1032/2036] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:47 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:47.901154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:47.901688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:47.908745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.909227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.909840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.910566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.911181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.911604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.951347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:47.951963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:47.959150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.959898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.960397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.961116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:47.961569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:47.962167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:47.981494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:47.991556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3a6c31ea-f269-4a1b-9f3f-a58e648cf3b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.094479 Sep 01 08:23:47.992124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1005/2037] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:47 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:48.031611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:48.040267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1294733d-fe6f-4830-92e9-5f7c21e06267 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.092649 Sep 01 08:23:48.040873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1033/2038] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:47 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:48.386336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:48.386909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:48.393017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:48.393491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:48.393915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:48.394630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:48.395070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:48.395491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:48.469622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:48.479750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf44141f-e043-4a4e-b7a8-d277ebe27b85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.097313 Sep 01 08:23:48.480351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1006/2039] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:48 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:48.543877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:48.544486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:48.551318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:48.551830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:48.552266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:48.552958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:48.553411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:48.553831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:48.620478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:48.628747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1adab449-1e0d-4233-a913-35ba5b401546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088484 Sep 01 08:23:48.629339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1034/2040] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:48 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:48.672889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:48.674223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:48.680158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:48.680640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:48.681074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:48.681764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:48.682230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:48.682674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:48.742745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:48.750665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:48.752831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:48.753935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-675fd47d-5efd-4478-874c-d031643a27e4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084977 Sep 01 08:23:48.754522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1007/2041] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:48 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:49.012510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:49.013025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:49.019672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.020150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.020582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.021264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.021713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.022130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.061085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:49.061782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:49.068489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.068973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.069401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.070088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.070560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.070980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.084351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:49.092250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f54e3cf-a51f-4ff1-a876-e8318e3a6a1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083627 Sep 01 08:23:49.092817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1035/2042] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:49 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:49.131686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:49.139284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-96525cf1-0732-4c1c-91e5-9fb59c4e5def tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081987 Sep 01 08:23:49.139871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1008/2043] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:49 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:49.501031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:49.501827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:49.508062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.508539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.508970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.509662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.510105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.510556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.572565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:49.580669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a368c329-2ba6-4b53-86cb-a2d5c20c2f70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083775 Sep 01 08:23:49.581115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1036/2044] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:49 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:49.649452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:49.650061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:49.656858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.658111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.658672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.659314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.659698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.660213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.723154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:49.730963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f4ffb044-8e76-409c-beb4-1a2efeecaeb3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085416 Sep 01 08:23:49.731732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1009/2045] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:49 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:49.776543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:49.777143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:49.783586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.784134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.784555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.785898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:49.785898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:49.786122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:49.852213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:49.860381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:49.862590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:49.863691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20d46dff-d7ff-4408-b65d-f059486dedc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091112 Sep 01 08:23:49.864254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1037/2046] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:49 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:50.159941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:50.160545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:50.166481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.166963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.167389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.168074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.168518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.168935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.246949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:50.255038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25eb60d3-807d-4c20-9ef4-9d531fe7f33b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.099082 Sep 01 08:23:50.255928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1038/2047] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:50 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:50.388954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:50.389662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:50.396641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.397126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.397557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.398286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.398733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.399152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.462743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:50.471006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bdeed8f7-1ceb-4196-a094-0cb525dea1da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.361186 Sep 01 08:23:50.471899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1010/2048] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:50 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:50.603179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:50.603790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:50.609740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.610295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.611290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.612004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.612458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.613122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.675328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:50.683144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b781752-809f-4339-a090-9cc0a71fa18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083910 Sep 01 08:23:50.683868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1039/2049] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:50 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:50.752285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:50.753470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:50.759402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.759878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.760511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.761202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.761647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.762064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.827585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:50.836293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-944ace9c-b28a-4e3f-8ff4-cd0e1f6de1d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087656 Sep 01 08:23:50.836883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1011/2050] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:50 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:50.886931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:50.887541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:50.893726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.894210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.894683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.895385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:50.895833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:50.896258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:50.956732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:50.966114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:50.967612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:50.968926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-05f092c3-0033-425c-89f6-2e36845edb15 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085744 Sep 01 08:23:50.969485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1040/2051] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:50 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:51.276923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:51.277720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:51.284314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.284865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.285414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.286112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.287436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.287849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.352116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:51.361013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-98a12952-08a7-4090-a46a-f1d755f0686d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.088203 Sep 01 08:23:51.361859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1012/2052] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:51 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:51.492374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:51.493082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:51.499153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.499640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.500068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.500765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.501211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.501636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.568707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:51.577042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-76c19e52-1ad5-4991-91d0-8d73ec9917ad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088346 Sep 01 08:23:51.577650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1041/2053] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:51 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:51.704228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:51.705265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:51.711901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.712399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.712893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.713607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.714085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.714534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.792869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:51.802906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62964aa8-659c-4f92-9afc-196d6edb5a9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.102538 Sep 01 08:23:51.803705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1013/2054] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:51 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:51.860117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:51.862037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:51.869715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.870357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.870869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.871595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:51.872050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:51.872477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:51.878186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:51.939301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:51.948054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-886298a6-0a50-4068-bb7a-9e23fc90048e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091023 Sep 01 08:23:51.948566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1042/2055] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:51 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:51.993095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:51.993850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:51.999721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.000324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.000818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.002283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.002794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.003277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.063449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:52.072373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:52.073718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:52.074833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c8d68d0d-9da2-4b49-a02c-4b435f8c7af8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085708 Sep 01 08:23:52.075383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1014/2056] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:51 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:52.380882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:52.381521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:52.387648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.388112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.388547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.389235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.389699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.390120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.455467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:52.464286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-98b380e1-6818-40ee-8ad9-2937ab97c090 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087053 Sep 01 08:23:52.464868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1043/2057] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:52 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:52.599341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:52.599970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:52.606135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.606658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.607142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.607819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.608261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.608675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.677309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:52.684908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0312efd3-1929-4c72-ad40-b6a1774dbec5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089781 Sep 01 08:23:52.685470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1015/2058] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:52 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:52.824073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:52.824687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:52.831249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.831661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.832092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.832783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.833310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.833798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.898000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:52.905583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c3ee9ac7-e99b-4698-98f3-c30e3b4a59c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085257 Sep 01 08:23:52.906181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1044/2059] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:52 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:52.968553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:52.969140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:52.976980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.976980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.977273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:52.977794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:52.978238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:52.978693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.047207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:53.056195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1d0e2733-d0ab-499c-bc4a-bd25eaac4dcc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091514 Sep 01 08:23:53.057236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1016/2060] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:52 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:53.097766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:53.098311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:53.104367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.104852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.105289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.105984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.106463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.106885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.167828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:53.175927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:53.177349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:53.178460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d10d56f0-d0e9-496b-ace2-9c2a0103c7cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085416 Sep 01 08:23:53.179009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1045/2061] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:53 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:53.487238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:53.487872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:53.494051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.494562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.494994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.495690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.496147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.496693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.565813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:53.573586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bea6cef3-d0b2-4661-b12a-288e0ca1b461 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090195 Sep 01 08:23:53.574169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1017/2062] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:53 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:53.707681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:53.708480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:53.715316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.715805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.716236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.716933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.717381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.717804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.784109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:53.792059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d5e55e33-3057-4c1b-a02f-4a3603c7ffd0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.089101 Sep 01 08:23:53.792635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1046/2063] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:53 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:53.927307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:53.927862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:53.933710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.934186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.934647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.935324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:53.935771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:53.936189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:53.996149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:54.004517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-18ac5e2f-f801-4ebf-b9df-b74fbc6c14dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081757 Sep 01 08:23:54.005069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1018/2064] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:53 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:54.077597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:54.078202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:54.085250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.085733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.086162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.086890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.087341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.087762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.152141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:54.160429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5017fe6b-85cc-46f5-8e40-6d40cb61edd7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086588 Sep 01 08:23:54.160994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1047/2065] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:54 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:54.200800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:54.201305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:54.208099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.208583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.209012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.209948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.210423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.210846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.228477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:54.274567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:54.282574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:54.284190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:54.285287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-06ae4b93-1e73-4d6a-8df7-9cb196c7441b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088451 Sep 01 08:23:54.285842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1019/2066] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:54 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:54.595563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:54.596349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:54.602353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.602829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.603249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.603915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.604354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.604771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.664753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:54.672327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28d5dfc4-95ac-4c0a-86dc-9890a22ccad5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081528 Sep 01 08:23:54.672882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1048/2067] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:54 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:54.812790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:54.813392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:54.820052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.820052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.820384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.821081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:54.821523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:54.821938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:54.889484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:54.898038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a2ebb8d-3757-4dbf-9c17-a6110615d346 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088852 Sep 01 08:23:54.898689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1020/2068] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:54 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:55.025807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:55.026535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:55.033690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.034264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.034773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.035521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.036058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.036475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.118187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:55.118187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d8a4fe80-dbfd-4b89-ab52-4bee2756b795 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.095587 Sep 01 08:23:55.118187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1049/2069] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:55 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:55.180640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:55.181249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:55.187220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.187775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.188125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.189539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.190053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.190510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.275167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:55.283046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f77ad5c7-94e3-4579-b2a5-af2ee1c58619 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.106167 Sep 01 08:23:55.283628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1021/2070] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:55 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:55.307403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:55.308033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:55.314936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.315411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.315839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.316519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.316968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.317386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.377012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:55.385575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:55.387052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:55.388153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe8b9634-7fae-46e3-978b-a4f081037d82 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084589 Sep 01 08:23:55.388707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1050/2071] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:55 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:55.693119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:55.693721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:55.699777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.700247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.700668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.701342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.701783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.702197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.762361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:55.772247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-162108eb-d024-4e52-a551-5bd0995b0962 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082508 Sep 01 08:23:55.772832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1022/2072] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:55 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:55.919091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:55.919690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:55.921555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:55.927322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.927799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.928228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.928909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:55.929353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:55.929775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:55.991290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:55.999093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5bb11ab4-4943-4ace-867b-dff7a6994a60 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083683 Sep 01 08:23:55.999662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1051/2073] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:55 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:56.138849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:56.139455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:56.145654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.146134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.146590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.147274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.147715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.148130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.211487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:56.219164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d310843b-b9b2-4673-b6cd-1bf935999ada tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084515 Sep 01 08:23:56.219730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1023/2074] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:56 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:56.303692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:56.304331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:56.311100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.311696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.312861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.313030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.314431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.314873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.386542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:56.395325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8e9a8bc8-6a7f-4fb6-8641-fb1c62877edc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095387 Sep 01 08:23:56.395913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1052/2075] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:56 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:56.415354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:56.415961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:56.422225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.422755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.423789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.424521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.425235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.425663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.493089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:56.501733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:56.503201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:56.504324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-68bd6de6-c6d5-4306-8c58-5c58c4fb5ae7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092904 Sep 01 08:23:56.504877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1024/2076] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:56 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:56.792969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:56.793928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:56.800920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.801661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.802096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.802841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:56.803296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:56.803717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:56.875731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:56.886752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8234e87d-2a95-4ece-954a-e188ed125628 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.097427 Sep 01 08:23:56.887653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1053/2077] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:56 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:57.021113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:57.021720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:57.028075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.028826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.029464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.030154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.030623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.031040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.098874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:57.107671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a6d2ea9-a4eb-44a5-b47c-9d12bf72c50c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090277 Sep 01 08:23:57.108437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1025/2078] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:57 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:57.239702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:57.240736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:57.247066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.247688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.249110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.249797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.250250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.250717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.329699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:57.337843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7cc1cff-5e16-4579-a2f9-efa85ff4d4ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.102477 Sep 01 08:23:57.338438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1054/2079] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:57 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:57.421312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:57.422047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:57.429532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.430151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.430619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.431322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.431768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.432179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.510764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:57.520017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2457827-5888-4b41-9a7a-3cdb500a72cd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.102473 Sep 01 08:23:57.520486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1026/2080] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:57 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:57.533327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:57.533327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:57.535429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.535960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.536579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.537152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.537599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.538019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.602399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:57.611088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:57.612891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:57.614003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b91b8ed0-116f-4c72-a992-3ae3a6155970 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090141 Sep 01 08:23:57.614584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1055/2081] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:57 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:23:57.909882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:57.910628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:57.927326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.927955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.928297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.929099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:57.929458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:57.932936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:57.998550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:58.007111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f39891f-6a3a-4728-995c-7ebfb2a2964e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.101683 Sep 01 08:23:58.007675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1027/2082] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:57 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:58.128795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:58.129421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:58.135173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.135649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.136078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.136766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.137208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.137623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.206955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:58.221631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ec52b57-ad46-4756-829a-2b059f45a1fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.096400 Sep 01 08:23:58.222500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1056/2083] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:58 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:58.359592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:58.360035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:58.366199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.366782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.367328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.368082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.368638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.369128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.434065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:58.442559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0692df07-bc00-4406-9b19-a54678be185c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086968 Sep 01 08:23:58.443130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1028/2084] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:58 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:23:58.541290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:58.542109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:58.549778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.550325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.550748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.551463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.551918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.552334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.619100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:58.627697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3821f7c-3c7c-47ba-b20a-ccbdf065bc85 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090230 Sep 01 08:23:58.628263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1057/2085] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:58 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:58.638012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:58.638780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:58.640706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:58.646077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.646588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.647023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.648081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:58.648533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:58.648957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:58.712577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:58.721289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:58.722840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:58.723931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d624d58e-c5c5-420b-9a6b-d472ada3cdb2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090602 Sep 01 08:23:58.724483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1029/2086] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:58 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:23:59.028578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:59.029223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:59.035526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.036003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.036510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.037192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.037637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.038051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.104081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:59.106313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:59.113080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b2695f2-12ba-4a8c-b41e-f123fb6e05f3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.088288 Sep 01 08:23:59.113657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1058/2087] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:59 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:59.244830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:59.245445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:59.252342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.252820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.253254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.253948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.254429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.254852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.319821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:59.334795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-89f7511a-bfd9-4613-98cd-210dde9d4ad7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.093362 Sep 01 08:23:59.335378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1030/2088] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:59 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:59.464227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:59.464745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:59.472223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.472933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.473160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.473889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.474362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.474790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.536268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:59.543992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9a214028-819f-4f0a-a135-2f9812b54049 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083901 Sep 01 08:23:59.544637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1059/2089] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:59 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:59.649529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:59.650579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:59.658150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.659151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.659692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.661402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.662343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.662343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.729189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:59.738041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8ad14aff-f9d0-467a-9fa4-373fd03e589d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.092690 Sep 01 08:23:59.738659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1031/2090] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:23:59 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:23:59.746988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:23:59.747692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:23:59.753743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.754336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.754682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.755374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:23:59.755826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:23:59.756246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:23:59.823064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:59.832036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:59.834051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:23:59.835485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-de06a623-de23-4609-96f2-77f93a78203d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092622 Sep 01 08:23:59.836106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1060/2091] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:23:59 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:00.135428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:00.136081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:00.142648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.143136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.143565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.144251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.144706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.145122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.206562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.214488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e856b407-5225-49af-b0c4-dbf2e85859c0 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082898 Sep 01 08:24:00.215085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1032/2092] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:00 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:00.300412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-805987863", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452"}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:24:00.350176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] validate_networks() for None {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:24:00.356309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:00.357134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:00.363997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.364567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.365063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.365828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.366419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.367044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.474681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.482666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bb9a4721-845f-4542-b359-819259761128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.130187 Sep 01 08:24:00.483354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1033/2093] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:00 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:00.565223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:00.565846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:00.571879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.572364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.572794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.573494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.573942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.574399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.646465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.653989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-98641416-8622-4119-91b5-015ab84bd163 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.092754 Sep 01 08:24:00.655233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1034/2094] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:00 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:00.707699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:24:00.708273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:24:00.708708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:24:00.709369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:24:00.709775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:24:00.718403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.718878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.719310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.720625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.721068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.721490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.738245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Getting quotas for project 34ed36f6fed0453c9f341c358c347dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:24:00.742224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Getting quotas for user 52600a45490f46cf944278b2d0684080 and project 34ed36f6fed0453c9f341c358c347dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:24:00.753457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:24:00.755831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:24:00.759404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:00.760025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:00.766332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.767345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.768275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.768472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.768928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.769350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.817119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a874cd3c-6faf-4406-84be-4e25e13c20e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520679 Sep 01 08:24:00.824153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1061/2095] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:24:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:24:00.833740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae659a2d-9de8-455b-a95e-b0c0c5927b30 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:00.835195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae659a2d-9de8-455b-a95e-b0c0c5927b30 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:00.855876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.864431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ef3177cc-253c-4977-a2aa-f76059674369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.109574 Sep 01 08:24:00.865504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1035/2096] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:00 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:00.871000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:00.871844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:00.879368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.880180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.880772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.881623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:00.882227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:00.882877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:00.887576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:00.912555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae659a2d-9de8-455b-a95e-b0c0c5927b30 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.921838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae659a2d-9de8-455b-a95e-b0c0c5927b30 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1214 microversion: 2.1 time: 0.095899 Sep 01 08:24:00.922933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1062/2097] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:00 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:00.952615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.962359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.964995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:00.966172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3c9670a2-9fae-416b-8330-523fa41b3fa0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.099200 Sep 01 08:24:00.966829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1036/2098] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:00 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:01.236629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:01.236883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:01.243510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.243987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.244418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.245096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.245543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.245962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.306669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:01.315021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-92996599-8a22-4a02-817a-1b0ff350b06c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083601 Sep 01 08:24:01.315584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1063/2099] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:01 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:01.504827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:01.505432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:01.511399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.511875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.512304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.512985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.513435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.513851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.583056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:01.597479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a60cd6d-e907-4955-ab2b-d7c06e82e395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.096863 Sep 01 08:24:01.598553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1037/2100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:01 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:01.676141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:01.676757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:01.682650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.683122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.683548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.684219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.684667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.685082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.744728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:01.752848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfc67062-5f90-4897-bdfc-ccfb77a8b62c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081187 Sep 01 08:24:01.753430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1064/2101] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:01 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:01.904168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:01.904787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:01.911542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.912025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.912454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.913162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.913612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.914028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.943047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:01.943651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:01.956732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.957223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.957658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.958447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:01.958899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:01.959590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:01.977018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:01.984916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bfb15b72-13ff-459e-a917-604a5f7b710a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084600 Sep 01 08:24:01.986342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1038/2102] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:01 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:01.995428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:01.996075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:02.002801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.003277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.003703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.004384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.004826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.005249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.027736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:02.036546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f7cfc9d-4d6b-4525-8293-5c784d3233bc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.097639 Sep 01 08:24:02.037116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1065/2103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:01 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:02.067473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:02.075342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:02.076757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:02.077842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3026ad4e-d9eb-4338-89bd-e9f2971ad7db tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086384 Sep 01 08:24:02.078418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1039/2104] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:01 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:02.336076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:02.336682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:02.342655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.343131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.343560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.344235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.345312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.345827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.404354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:02.412856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17d029e2-a015-492d-bf9c-840e72dad524 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080797 Sep 01 08:24:02.413427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1066/2105] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:02 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:02.620904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:02.621430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:02.627892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.628363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.628794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.629476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.629917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.630370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.691653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:02.699524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cc3d2d0d-0369-47b5-b594-d221cc1351d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082362 Sep 01 08:24:02.700104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1040/2106] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:02 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:02.773533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:02.774132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:02.780057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.780533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.780964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.781638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:02.782782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:02.783286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:02.842520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:02.850782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30a29630-7385-4aa1-9a96-ca42ba0b4ea1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081078 Sep 01 08:24:02.851338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1067/2107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:02 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:03.007767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:03.008477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:03.014458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.014933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.015366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.016052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.017465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.017892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.061435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:03.062562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:03.073014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.073848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.074637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.075854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.076663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.077445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.101428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.109272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-684d3650-d67e-40f1-b5df-c57c46050635 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.105633 Sep 01 08:24:03.109839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1041/2108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:03 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:03.123690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:03.124300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:03.131327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.131817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.132273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.132952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.133405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.133828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.150157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.158463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-737a8008-1325-4b62-aa9f-e23669e99a25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.104105 Sep 01 08:24:03.159038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1068/2109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:03 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:03.195359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.203312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.205502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.206622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2fa6cd4f-42d6-41d5-be9e-1f2920fe0a25 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086755 Sep 01 08:24:03.207176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1042/2110] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:03 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:03.432540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:03.433148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:03.439620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.440139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.440578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.441511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.441991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.442662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.504033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.517110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b63e1a25-cb86-4f98-b4e1-a96b41ca65cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087704 Sep 01 08:24:03.517843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1069/2111] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:03 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:03.721937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:03.722479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:03.728441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.728914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.729335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.730056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.730520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.730934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.796135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.804388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-17e05959-f5dc-46fa-a83b-4048b4843c33 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086434 Sep 01 08:24:03.804968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1043/2112] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:03 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:03.871992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:03.872604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:03.878874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.879354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.879778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.880462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:03.880902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:03.881321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:03.941445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:03.948994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-31f2c5f6-daf7-42f0-a517-d06b2430234c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081424 Sep 01 08:24:03.949573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1070/2113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:03 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:04.130966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:04.131605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:04.138240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.138740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.139171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.139869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.140402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.140714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.179046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:04.179651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:04.186551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.187048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.187479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.188186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.188687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.189106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.207822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:04.215638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d71869d7-8f28-4872-a88a-7de4dad82450 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088617 Sep 01 08:24:04.216403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1044/2114] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:04 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:04.231105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:04.231703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:04.238701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.239182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.239606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.240291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.240730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.241142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.252707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:04.260317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7cdfe2f-f5e1-4b24-bf1f-b1c0f5b39b8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085111 Sep 01 08:24:04.260959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1071/2115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:04 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:04.303661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:04.311684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:04.313092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:04.314278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91e7461f-a44f-4aa9-8531-b40686a555ee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086876 Sep 01 08:24:04.314836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1045/2116] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:04 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:04.538742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:04.539347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:04.545234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.545710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.546158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.546849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.547297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.548224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.743737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:04.751916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95f5075f-78f7-4c5a-9699-4b1c53d1b4c9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.217232 Sep 01 08:24:04.752463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1072/2117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:04 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:04.825733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:04.826390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:04.832908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.833414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.833856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.834786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.835227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.835641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.895720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:04.903458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a6c96cb-2911-4fee-a723-30498b47ba48 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081740 Sep 01 08:24:04.904031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1046/2118] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:04 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:04.971212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:04.971814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:04.978033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.978553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.978984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:04.979679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:04.980175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:04.980734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.042245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:05.050592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85d0dc91-eb9c-4f91-a3c6-1432d49046a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083779 Sep 01 08:24:05.051179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1073/2119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:04 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:05.241544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:05.242859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:05.249011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.249486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.249916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.250678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.251295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.251544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.281001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:05.281607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:05.289048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.289580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.290194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.290775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.291225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.291680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.316837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:05.324463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fea59566-5906-43b3-881c-1455651687d8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090819 Sep 01 08:24:05.325027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1047/2120] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:05 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:05.336360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:05.337128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:05.343202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.343679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.344106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.344793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.345237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.345657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.355410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:05.363858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-472591d2-8cdf-4f2c-9caa-93a0b395792e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086638 Sep 01 08:24:05.364436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1074/2121] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:05 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:05.407829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:05.415755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:05.417178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:05.418308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-88228233-9d9f-40b3-9c3e-95360cc78f33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086075 Sep 01 08:24:05.419027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1048/2122] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:05 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:05.772682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:05.773211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:05.779155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.779632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.780064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.780744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.781193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.781614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.844404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:05.854123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5c8aa783-d714-474f-93a1-c23b8b96c974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084484 Sep 01 08:24:05.854743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1075/2123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:05 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:05.923751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:05.924363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:05.930942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.931420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.931856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.932532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:05.932976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:05.933394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:05.994229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.002469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb2b7ac5-3bb2-4246-bae8-a6e22e146bff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082446 Sep 01 08:24:06.003045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1049/2124] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:05 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:06.071480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:06.072120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:06.078115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.078630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.079063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.079767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.080221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.080643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.147616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.155145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e88d54a5-f630-452f-a4eb-a00debc534fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088111 Sep 01 08:24:06.155700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1076/2125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:06 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:06.345643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:06.346358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:06.353042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.353522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.353949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.354701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.355143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.355566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.388410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:06.389454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:06.397681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.398162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.398791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.399486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.399941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.400359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.404619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:06.425183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.433889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-99ca137c-21f2-4b9b-a7c1-06752bb63463 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.092174 Sep 01 08:24:06.434483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1050/2126] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:06 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:06.441431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:06.442472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:06.449026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.449499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.449921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.450637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.451079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.451491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.468861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.486551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fede02c4-87a4-4ef2-874e-bf4fe193ffc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.104714 Sep 01 08:24:06.487352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1077/2127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:06 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:06.515041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.524099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.525506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.526626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d66aaa5e-d1e7-423a-92b6-0b3afc8ec3a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088738 Sep 01 08:24:06.527170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1051/2128] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:06 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:06.875685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:06.876280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:06.882669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.883152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.883586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.884277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:06.884727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:06.885146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:06.948010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:06.955613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7665ab71-9d17-4a50-a5d3-eca86ca3a9c3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083706 Sep 01 08:24:06.956178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1078/2129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:06 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:07.023828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:07.024430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:07.030299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.030781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.031213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.031893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.032337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.032751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.094968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:07.098358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:07.103598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a6be541b-ecf8-46dd-985f-b2e31d6cc08a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084392 Sep 01 08:24:07.104171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1052/2130] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:07 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:07.175366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:07.175919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:07.183289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.183778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.184212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.184910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.185359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.185785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.249075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:07.256725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-70d6007a-ddbe-4feb-b704-443630e667f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085331 Sep 01 08:24:07.257279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1079/2131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:07 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:07.454673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:07.455234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:07.462687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.463177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.463596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.464281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.464725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.465130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.509065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:07.509677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:07.515744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.516224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.516687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.517378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.517823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.518238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.532382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:07.540743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c0366806-be64-410f-bbbc-d794e83e52c1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090359 Sep 01 08:24:07.541326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1053/2132] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:07 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:07.548850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:07.549541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:07.556876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.557362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.557799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.558525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.558978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.559401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.586082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:07.593960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c91338df-99a5-4ae8-8409-5e6c798ffd8f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090416 Sep 01 08:24:07.594554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1080/2133] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:07 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:07.624724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:07.633630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:07.635075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:07.636162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3b3a49ae-7530-43f4-bef9-69c3985611f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091199 Sep 01 08:24:07.636708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1054/2134] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:07 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:07.977193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:07.977794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:07.983643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.984118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.984542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:07.985217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:07.985664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:07.986086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.045592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.054175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf81cc6e-460b-49af-b413-547782e64b19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080904 Sep 01 08:24:08.054786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1081/2135] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:07 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:08.124791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:08.125395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:08.132515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.133026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.133458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.134146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.134622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.135075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.196739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.204580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-794db9c2-ef8e-470f-adf1-96c5c2182fba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083579 Sep 01 08:24:08.205130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1055/2136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:08 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:08.277482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:08.278110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:08.284301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.284785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.285221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.286706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.287474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.287905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.354099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.361941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cb603e4f-73c5-42e1-ba8c-49ca4495b3c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088233 Sep 01 08:24:08.362552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1082/2137] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:08 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:08.563164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:08.563962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:08.570274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.570774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.571213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.571913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.572358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.572773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.615640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:08.616340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:08.622602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.623166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.623663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.624439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.624954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.625436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.641176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.649664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47fc1804-5c4c-4eb1-ad5e-89b3f36f81cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090908 Sep 01 08:24:08.650240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1056/2138] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:08 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:08.658101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:08.658811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:08.665369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.665927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.666481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.667214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:08.667662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:08.668075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:08.686457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.694772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24706c91-e98c-4d63-8689-60e95b68ee71 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083605 Sep 01 08:24:08.695341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1083/2139] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:08 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:08.729061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.737049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.738488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:08.740261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f73a9a4b-d80e-44b5-b0aa-6b51edc4814e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085717 Sep 01 08:24:08.740808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1057/2140] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:08 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:09.074977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:09.075582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:09.081452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.081927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.082383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.083724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.084425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.084842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.149882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.157468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d2053767-3cb8-4a60-b3ff-0ef21af351cf tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086457 Sep 01 08:24:09.158026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1084/2141] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:09 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:09.225246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:09.225913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:09.231930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.232400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.232829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.233501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.233942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.234381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.294432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.301933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3e2d95da-9494-498f-9768-32c34372059d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080505 Sep 01 08:24:09.302538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1058/2142] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:09 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:09.383226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:09.383792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:09.389923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.390450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.390881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.391575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.392025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.392445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.456324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.465260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a12b2248-989c-4509-a65c-f590d4c11cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086010 Sep 01 08:24:09.466157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1085/2143] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:09 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:09.670946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:09.671573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:09.678423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.678922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.679332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.680022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.680465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.680893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.719884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:09.721082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:09.729902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.730747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.731451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.732587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.733306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.734083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.747601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.760688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6655b8ec-801b-41aa-89f0-b4bd63337fad tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.093249 Sep 01 08:24:09.761577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1059/2144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:09 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:09.767270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:09.768094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:09.775842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.776634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.777379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.778594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:09.779367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:09.780127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:09.818585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.826238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-774a3234-3203-4397-a1b1-dcd4e86e50e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.113503 Sep 01 08:24:09.826832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1086/2145] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:09 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:09.853342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.861506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.862957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:09.864859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8c8c5dd6-9f11-4a71-8702-8e748bf8bb47 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.101267 Sep 01 08:24:09.865420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1060/2146] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:09 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:10.177955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:10.178593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:10.184854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.185338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.185768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.186487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.186936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.187353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.248274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.256940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d48d80fc-d137-4839-aefe-57f43828aab2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082863 Sep 01 08:24:10.257497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1087/2147] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:10 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:10.323528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:10.324131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:10.330367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.330854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.331476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.332010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.333187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.333740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.395492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.403652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1501979f-a5af-475d-b2af-81d411645cd2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083893 Sep 01 08:24:10.404220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1061/2148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:10 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:10.486439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:10.487061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:10.493739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.494225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.494693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.495373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.495846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.496270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.564189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.572563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25c7caaf-42a1-4450-8d6e-d85656aad628 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089852 Sep 01 08:24:10.573147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1088/2149] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:10 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:10.782655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:10.783272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:10.789865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.790388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.790823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.791538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.791990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.792403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.849877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:10.850559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:10.852435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:10.854039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.857880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.858397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.858823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.859509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.859950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.860367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.861638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c05a9d5f-9309-48aa-bf20-5dcac49eaccb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082809 Sep 01 08:24:10.862198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1062/2150] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:10 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:10.888310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:10.888906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:10.895099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.895716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.896220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.896981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:10.897530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:10.898019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:10.923843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.926056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=8 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:10.933917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8892b51c-88bd-4501-8a9b-c59b342f6c7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088744 Sep 01 08:24:10.934519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1089/2151] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:10 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:10.960413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.968449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.969860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:10.970961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e6f35a8-435e-4678-a48c-0e4e968e332e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086752 Sep 01 08:24:10.971505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1063/2152] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:10 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:11.277395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:11.277999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:11.284131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.284617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.285109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.286045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.287236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.287668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.351239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:11.358828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-868b911a-092b-4a1b-b7a2-99c5f091f53a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085236 Sep 01 08:24:11.359395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1090/2153] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:11 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:11.423931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:11.429711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:11.431064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.431555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.431993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.432690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.433142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.433566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.497260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:11.504927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d56410c3-83f2-4f39-9549-8029792d7916 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084775 Sep 01 08:24:11.505581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1064/2154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:11 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:11.593679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:11.594309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:11.601164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.601578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.602008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.602723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.603176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.603595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.664526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:11.672421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-55473296-cdd3-41bd-8f14-02e2c476b4da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083159 Sep 01 08:24:11.672997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1091/2155] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:11 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:11.884270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:11.884879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:11.891026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.891510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.891938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.892622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.893068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.893487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.954517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:11.954988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:11.956902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:11.961723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.962195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.962645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.963323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:11.963769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:11.964214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:11.965595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-74e616a2-c6f9-42cd-b707-9db29fff0468 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086143 Sep 01 08:24:11.966162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1065/2156] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:11 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:11.994531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:11.995138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:12.001165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.001650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.002085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.002801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.003255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.003680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.030743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:12.038400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e72ba443-4815-446e-ae3e-eb18d16b2eb8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088048 Sep 01 08:24:12.038969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1092/2157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:11 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:12.064515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:12.073359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:12.074820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:12.075909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09bc3b43-fb61-4eb0-9afb-2e331211044d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085146 Sep 01 08:24:12.076458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1066/2158] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:11 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:12.379352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:12.379960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:12.381811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:12.387229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.387704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.388137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.388824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.389270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.389687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.451275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:12.453565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:12.461044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d39bb999-c1e5-49fa-bfd9-ef041cbdc1e2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085449 Sep 01 08:24:12.461594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1093/2159] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:12 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:12.525734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:12.526355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:12.532346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.532822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.533248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.533927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.534398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.534814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.597386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:12.605887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec1221b2-8159-499a-802e-77992cd3a0a5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083992 Sep 01 08:24:12.606481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1067/2160] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:12 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:12.693398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:12.694009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:12.699923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.700399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.700828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.701517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.701968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.702425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.768984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:12.777963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fba6ff16-1e6e-4e64-b928-fde974ce8a69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088247 Sep 01 08:24:12.778784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1094/2161] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:12 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:12.987341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:12.987900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:12.994525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.995033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.995465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:12.996169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:12.996610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:12.997034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.058874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.059491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:13.060100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:13.065922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.066447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.066563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fd70eef1-c503-4bc5-b708-ccda821e0630 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082989 Sep 01 08:24:13.067398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.068088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.068536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.068960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.072368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1068/2162] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:12 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:13.099573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:13.100316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:13.106553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.107514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.107704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.108391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.108832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.109243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.127875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:13.130799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.138420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2de35ab8-6994-4fbb-9cee-88227b557380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082741 Sep 01 08:24:13.138982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1095/2163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:13 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:13.170883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.179828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.181244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.182346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f4ac8acb-b183-4b19-9de6-9e196e250b2a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087517 Sep 01 08:24:13.182891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1069/2164] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:13 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:13.482030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:13.482720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:13.489827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.490410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.490839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.491666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.492132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.492605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.555533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.563576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8e460a92-befd-44d9-8e1b-582f3cfc5e30 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084810 Sep 01 08:24:13.563733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1096/2165] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:13 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:13.626559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:13.627201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:13.634084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.634611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.635049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.635728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.636180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.636599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.695636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.703329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-18ba4f44-b64d-4de6-babe-6590d4267466 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080560 Sep 01 08:24:13.703893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1070/2166] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:13 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:13.799506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:13.800110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:13.806690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.807158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.807580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.808277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:13.808717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:13.809131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:13.870619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:13.878535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1ca816ee-ba81-4628-9cbb-a6be8689cd55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082741 Sep 01 08:24:13.879118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1097/2167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:13 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:14.088656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:14.089218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:14.095188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.095668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.096101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.096794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.097236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.097657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.158960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:14.159184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.159567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:14.166208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.166721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.167151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.167491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-85f806fb-e4ae-4619-9eaa-5956998eb1fe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082867 Sep 01 08:24:14.167831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.168041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1071/2168] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:14 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:14.168277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.168695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.204525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:14.205137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:14.212240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.212721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.213147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.213831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.214302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.214713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.232387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.240823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f87591fe-68d5-4b36-84dd-aee296ab73c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085612 Sep 01 08:24:14.241400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1098/2169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:14 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:14.275334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.283379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.284793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.286623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d6dc0e1-6a68-48a2-a9df-970ebce3e681 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085569 Sep 01 08:24:14.287256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1072/2170] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:14 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:14.585409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:14.586037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:14.592033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.592505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.592935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.593607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.594048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.594488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.653085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.661391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a5d2f096-bb76-4f52-b6d8-fd95a1d5c59b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080208 Sep 01 08:24:14.662047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1099/2171] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:14 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:14.725719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:14.726356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:14.732213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.732704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.733139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.733829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.734289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.734713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.794455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.801950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8725d378-7ff8-4dc3-b909-a83cc3e5ce1a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080792 Sep 01 08:24:14.802545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1073/2172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:14 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:14.901498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:14.902065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:14.907882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.908353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.908776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.909452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:14.909898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:14.910347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:14.975045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:14.983328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7d4d53ab-ce62-4fd2-a337-b63311a03aee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085613 Sep 01 08:24:14.983920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1100/2173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:14 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:15.188576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:15.189128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:15.195147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.195623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.196050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.196732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.197176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.197592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.262376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:15.262572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:15.262980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:15.268920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.269391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.269825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.270638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b9fbefd8-d046-4046-97d5-f305a6954d7c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085417 Sep 01 08:24:15.276015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1074/2174] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:15 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:15.276172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.276172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.276172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.309989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:15.310744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:15.317756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.318752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.319594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.320372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.320903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.321406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.333927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:15.341464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dad8c8bf-88dc-4f1d-9554-5cce809c7b20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083702 Sep 01 08:24:15.350296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1101/2175] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:15 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:15.383011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:15.391403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:15.392840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:15.393933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-066f7965-196a-4dd3-b264-e58ea27623d2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088839 Sep 01 08:24:15.394528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1075/2176] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:15 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:15.682544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:15.683142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:15.688949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.689427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.689852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.690559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.691002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.691414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.753307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:15.761752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17aead50-44a3-420b-96ca-b73d4808d1b9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083025 Sep 01 08:24:15.762336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1102/2177] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:15 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:15.823076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:15.823680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:15.829568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.830038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.830507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.831184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:15.831633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:15.832051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:15.892320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:15.900070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-89837ffc-c08e-4ee2-b525-8f92ae8d50a2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080967 Sep 01 08:24:15.900632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1076/2178] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:15 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:16.004478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:16.005168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:16.011440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.011592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.011965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.012637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.013078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.013493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.080764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.088832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1c67627d-ff47-4ea1-a172-7181130bcb40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088163 Sep 01 08:24:16.089412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1103/2179] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:15 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:16.291635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:16.292458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:16.298427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.298909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.299338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.300025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.300470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.300885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.361283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:16.361927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:16.362680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.369129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.369718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.370208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.370924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.371373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.371710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ff3189d-d430-4992-96c5-8bf16e694b3f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083869 Sep 01 08:24:16.371911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.372321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1077/2180] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:16 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:16.416622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:16.417221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:16.423143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.423622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.424049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.424718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.425167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.425583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.434923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.443280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9549b9e7-f3b0-4c5f-ab32-bcc87a919187 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085766 Sep 01 08:24:16.444052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1104/2181] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:16 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:16.488710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.496905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.498365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.499456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a5b0e54-3458-428c-b97d-ce89a2b8160a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086726 Sep 01 08:24:16.500009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1078/2182] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:16 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:16.782725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:16.783339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:16.789734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.790197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.790668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.791370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.791817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.792233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.852356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.860028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6aabb588-6fc1-42e4-85e5-e3f31cdb03b1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081120 Sep 01 08:24:16.860614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1105/2183] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:16 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:16.920797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:16.921460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:16.923296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:16.929410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.929938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.930396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.931080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:16.931527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:16.931943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:16.992237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:16.999695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ba23d0d4-3866-4e0d-8c6a-caec30925b13 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082691 Sep 01 08:24:17.000248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1079/2184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:16 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:17.109996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:17.110579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:17.116954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.117431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.117861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.118562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.119013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.119429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.184172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:17.192926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-acc55362-b6e0-4fae-8804-39e73d29e7cb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086744 Sep 01 08:24:17.193709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1106/2185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:17 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:17.393155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:17.393737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:17.399693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.400165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.400590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.401269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.401712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.402124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.464396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:17.464881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:17.465521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:17.471571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.472541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.472541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.473162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.473643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.474034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.474355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2aa80768-9a31-4adb-9002-e99a98860006 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084998 Sep 01 08:24:17.474936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1080/2186] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:17 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:17.522153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:17.522780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:17.528804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.529287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.529715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.534556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.535044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.535478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.540927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:17.549170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1376d57-f949-4b31-9ce0-f5b01af3aed0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088125 Sep 01 08:24:17.549740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1107/2187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:17 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:17.610729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:17.619940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:17.621447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:17.622558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31400905-654a-468b-b319-d54a35edf76b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.105073 Sep 01 08:24:17.623296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1081/2188] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:17 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:17.881348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:17.881950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:17.887898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.888385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.888816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.889496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:17.889946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:17.890398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:17.956692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:17.965467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-67445b4a-a430-4287-8c82-193545d6238d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087967 Sep 01 08:24:17.966030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1108/2189] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:17 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:18.020719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:18.021319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:18.027232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.027702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.028127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.028795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.029235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.029648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.090323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:18.097797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-51d1ed9d-b380-4249-9bc9-a3d6702b3390 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081654 Sep 01 08:24:18.099268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1082/2190] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:18 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:18.214638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:18.215224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:18.221145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.221619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.222045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.222746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.223814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.224270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.284353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:18.292686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c366463c-0fad-4e06-9036-fa3ceeff8ce9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081859 Sep 01 08:24:18.293255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1109/2191] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:18 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:18.495331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:18.495968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:18.501955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.502483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.502909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.503590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.504110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.505115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.566567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:18.569774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:18.570570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:18.575470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb600921-b008-45a9-ba6f-6b7cc4a69d9c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083929 Sep 01 08:24:18.576046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1083/2192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:18 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:18.577202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.577695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.578126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.578847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.579300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.579720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.595233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:18.643326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:18.645248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:18.645849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:18.651198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-14d83e18-08ae-4a5f-b2da-e88f212f34ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086148 Sep 01 08:24:18.651940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1110/2193] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:18 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:18.652068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.652339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.652792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.653468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.653914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.654360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.714910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:18.722879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:18.724338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:18.725423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d2839c7-06d4-48da-9199-3e7b41b4f433 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084336 Sep 01 08:24:18.725979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1084/2194] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:18 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:18.986962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:18.987501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:18.994013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.994519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.994947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:18.995623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:18.996064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:18.996482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.055465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.062993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f5891c10-02cc-4e71-93ab-6c23a52a9407 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079949 Sep 01 08:24:19.063544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1111/2195] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:18 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:19.118552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:19.119156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:19.125407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.125873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.126318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.126986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.127425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.127836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.187250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.196257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-561605bd-e9f5-4ad8-a862-aae9ec320ece tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081482 Sep 01 08:24:19.196819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1085/2196] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:19 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:19.313801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:19.314466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:19.320951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.321422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.321847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.322540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.322982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.323395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.386794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.394516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-960e7c72-2bb5-4679-aeac-2a67681c035f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084466 Sep 01 08:24:19.395130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1112/2197] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:19 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:19.597747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:19.598363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:19.604310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.604793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.605222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.605898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.606365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.606795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.610808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:19.671344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.671988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:19.672644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:19.678679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.679157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.679590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.679723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-edae5ecf-80ee-40e5-8fa4-f4b2b7687cb0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086370 Sep 01 08:24:19.680216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1086/2198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:19 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:19.680405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.680859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.681278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.740792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.746960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:19.747554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:19.748675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f32e048-147d-4579-87d7-ee014581d7db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080628 Sep 01 08:24:19.749237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1113/2199] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:19 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:19.753622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.754724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.755257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.755949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:19.756451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:19.756810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:19.816392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.825129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.826563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:19.827676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a45f64c-aded-4aab-a5e7-8b5db1726506 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084573 Sep 01 08:24:19.828219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1087/2200] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:19 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:20.084679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:20.085290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:20.091222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.091695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.092126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.092807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.093252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.093674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.155952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.164212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee0ff07d-1983-42b5-906d-3f413f0898f2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084122 Sep 01 08:24:20.164771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1114/2201] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:20 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:20.220621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:20.221218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:20.227197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.227670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.228099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.228769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.229255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.229669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.290143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.297634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-171752aa-c8ee-4893-a0fc-19087e5fa3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080777 Sep 01 08:24:20.298186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1088/2202] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:20 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:20.415071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:20.415675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:20.421543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.422019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.422496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.423168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.423615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.424036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.485810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.495093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e8c9664-6b6f-4a41-bcd7-8436161e0db0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083679 Sep 01 08:24:20.495666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1115/2203] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:20 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:20.700760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:20.701420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:20.707929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.708461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.709151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.709831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.710296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.710716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.771980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:20.772492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:20.774221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.778918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.779402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.779836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.780558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.781011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.781433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.781897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-608cb330-35f8-47f4-8a3a-e98efc875101 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085084 Sep 01 08:24:20.782690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1089/2204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:20 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:20.846297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.851477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:20.852076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:20.854701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-306fe675-b2a6-4b6e-9c6f-5f3d6a75d349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087489 Sep 01 08:24:20.855285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1116/2205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:20 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:20.858187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.858686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.859130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.859791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:20.860236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:20.860650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:20.921744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.930026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.931486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:20.932575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2710be99-aa44-41ab-b8be-bb0c6b6e0ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085729 Sep 01 08:24:20.933131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1090/2206] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:20 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:21.184911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:21.185716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:21.192714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.193199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.193628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.194358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.194936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.195483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.272949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:21.280751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-98925e19-e183-4761-b52e-4d9a6a906466 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.099675 Sep 01 08:24:21.281310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1117/2207] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:21 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:21.319644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:21.320264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:21.328035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.328518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.329034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.329725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.330961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.331992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.415769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:21.424961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dbc57b5b-2590-4309-b4fa-16c6a6bfb09c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.110163 Sep 01 08:24:21.425530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1091/2208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:21 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:21.518618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:21.519703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:21.526882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.527356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.527791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.528487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.529193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.529690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.603850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:21.614006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-67bad1a7-8d1b-4b1a-b13e-0422c8875eb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.101333 Sep 01 08:24:21.614988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1118/2209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:21 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:21.804431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:21.805033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:21.811281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.811762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.812194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.812883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.813334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.813753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.875218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:21.875831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:21.876549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:21.883623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.884156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7be6133e-64b0-4b11-8883-436b32dd7546 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084648 Sep 01 08:24:21.884453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.884724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1092/2210] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:21 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:21.885227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.886538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.887110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.887745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.952848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:21.955495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:21.956099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:21.963053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.963529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.963956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.964631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:21.965075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:21.965494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:21.967575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-64bd91aa-907b-4da2-b71a-dd74661cbd0e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.096098 Sep 01 08:24:21.968635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1119/2211] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:21 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:22.027881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:22.036290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:22.037715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:22.038846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5bc92dc8-5778-47dc-8a33-a840f8595a4a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087817 Sep 01 08:24:22.039396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1093/2212] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:21 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:22.304265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:22.304872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:22.310856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.311330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.311758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.312425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.312866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.313282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.375443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:22.383602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c628212d-3783-485e-889d-8b67fe460e19 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083665 Sep 01 08:24:22.384157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1120/2213] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:22 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:22.453452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:22.454058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:22.460430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.460906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.461337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.462010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.462488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.462910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.637114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:22.637698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:22.643599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.644080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.644511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.645895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.646420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.646840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.669998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:22.678580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1faad1a-8a5b-4b58-af32-8056985f1853 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.228896 Sep 01 08:24:22.679252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1094/2214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:22 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:22.709252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:22.717011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d68120a2-5be6-444f-92e7-daf097dc91ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083752 Sep 01 08:24:22.717570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1121/2215] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:22 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:22.906482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:22.907170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:22.914182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.914716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.915215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.915912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.916360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.916775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.983208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:22.988810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:22.989494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:22.991276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-86a7145b-18eb-4288-9669-b9fc1ae06286 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089548 Sep 01 08:24:22.991848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1095/2216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:22 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:22.995549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.996031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.996491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:22.997178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:22.997622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:22.998041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.058387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:23.061599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:23.062209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:23.065997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21e62b5c-0ac2-441e-bfa1-903b03eb6d89 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081309 Sep 01 08:24:23.066826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1122/2217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:22 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:23.068244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.068718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.069148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.069834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.070305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.070730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.132332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:23.140452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:23.141872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:23.142983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-686412b5-0d68-4882-b96c-d76f7723e961 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085176 Sep 01 08:24:23.143538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1096/2218] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:23 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:23.565527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:23.566216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:23.572755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.573238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.573673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.574394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.574847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.575265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.634794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:23.642318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8ac2bcfa-8dde-45c9-9e25-75b4015f16da tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.242424 Sep 01 08:24:23.642908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1123/2219] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:23 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:23.699070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:23.699594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:23.705598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.706068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.706529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.707790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.708261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.708925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.737982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:23.739188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:23.745220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.745695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.746127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.746835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:23.747276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:23.747691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:23.768856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:23.777294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9430c5b7-7eab-4d09-875c-00ba0976cc76 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082007 Sep 01 08:24:23.777963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1097/2220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:23 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:23.810059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:23.819121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b54d953f-6464-4c08-8722-52e3b4179ebb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084764 Sep 01 08:24:23.819694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1124/2221] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:23 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:24.012686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:24.013251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:24.019272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.020267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.021007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.021774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.022230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.022680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.087657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:24.087906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.088260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:24.094272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.094774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.095201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.095878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.096052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d3a784f0-c4f2-4fed-8024-9c1f3bbd8035 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087356 Sep 01 08:24:24.096322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.096623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1098/2222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:24 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:24.096730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.157115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.165411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b695840a-43ad-4d42-9d15-ef730a1d846b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081788 Sep 01 08:24:24.165587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:24.165972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1125/2223] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:24 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:24.166132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:24.172185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.172661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.173095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.173773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.174217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.174658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.234746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.243522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.244962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.246060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04fa38d9-94e3-49a1-9c93-7296fa061c79 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084445 Sep 01 08:24:24.246647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1099/2224] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:24 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:24.663639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:24.664188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:24.670010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.670512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.670939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.671613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.672059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.672475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.731486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.739444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0b060a5-9ad4-490c-8e22-c227252a3303 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079816 Sep 01 08:24:24.740011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1126/2225] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:24 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:24.798627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:24.799227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:24.805132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.805596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.806028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.806726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.807167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.807580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.839621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:24.840230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:24.846488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.846982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.847419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.848374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:24.848899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:24.849328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:24.853471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:24.870936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.879668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9d8f8672-4374-4df1-813f-c736741d4e91 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084274 Sep 01 08:24:24.880237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1100/2226] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:24 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:24.914405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:24.922379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fdf2ad32-adbf-4e8b-9103-c6348aff8f35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086426 Sep 01 08:24:24.922957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1127/2227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:24 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:25.117874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:25.118520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:25.124780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.125263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.125695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.126430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.126882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.127302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.186852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:25.187458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:25.189152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:25.193550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.194035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.194496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.195180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.195626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.196042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.197003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-52cb5c43-e434-443a-b7e3-736c2c8a0973 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083770 Sep 01 08:24:25.197568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1101/2228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:25 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:25.258691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:25.266382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-201570ea-1d72-440d-b35c-2f5939082f25 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083659 Sep 01 08:24:25.266943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1128/2229] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:25 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:25.268591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:25.269198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:25.275930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.276412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.276843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.277523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.277970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.278419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.340244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:25.343581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:25.349408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:25.350883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:25.351974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c1011be8-3473-4aa0-b638-6d364b65ed10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087345 Sep 01 08:24:25.352524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1102/2230] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:25 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:25.759572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:25.760121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:25.766138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.766668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.767101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.767819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.768266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.768684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.830865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:25.839066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6680cd65-985b-4854-8fd6-136d0397214a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083447 Sep 01 08:24:25.839618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1129/2231] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:25 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:25.901433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:25.902040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:25.907966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.908504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.908882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.909651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.910681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.911336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.944202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:25.944815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:25.950978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.951468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.951882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.952559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:25.953000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:25.953415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:25.978444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:25.986197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d283e4d-21ff-4170-a8ad-c1cef1bdeb68 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.088874 Sep 01 08:24:25.986801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1103/2232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:25 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:26.020152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:26.028211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-142d106a-34b5-4530-bdee-6021e1706542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088163 Sep 01 08:24:26.028774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1130/2233] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:25 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:26.218471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:26.219234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:26.225761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.226244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.226702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.227389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.227837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.228263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.288098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:26.288736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:26.293634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:26.294906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.295385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.295812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.296500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.296940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.297357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.302034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62411418-c661-41db-939c-e967695d1395 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087362 Sep 01 08:24:26.302979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1104/2234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:26 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:26.359343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:26.367789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-78b667e9-9841-4357-a5dd-a9fb771e24c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084288 Sep 01 08:24:26.368351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1131/2235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:26 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:26.374198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:26.374828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:26.380993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.381483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.381943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.382636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.383085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.383502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.443164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:26.451395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:26.452870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:26.453972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1bcb7fab-4cba-45bd-b206-7197997a4345 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083616 Sep 01 08:24:26.454577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1105/2236] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:26 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:26.860849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:26.861449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:26.868119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.868591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.869015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.869739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:26.870223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:26.870753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:26.930910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:26.938473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b50d14f0-1cf3-47e7-98f7-05ac890ca441 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081432 Sep 01 08:24:26.939030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1132/2237] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:26 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:27.007415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:27.007955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:27.013789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.014286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.014716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.015393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.015835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.016267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.048579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:27.049182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:27.055304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.055789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.056222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.056941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.057636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.057982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.080560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:27.090431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9e37e285-98a1-46b2-ab23-ffc74ae054ce tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086635 Sep 01 08:24:27.091009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1106/2238] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:27 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:27.139747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:27.148472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-132666b4-ed42-4911-b4ca-576567763e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.103557 Sep 01 08:24:27.149046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1133/2239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:27 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:27.322618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:27.323200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:27.329455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.329945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.330407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.331109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.331564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.332028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.388383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:27.388897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:27.395564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.395873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.396308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.397367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.397548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.397968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.401531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:27.409235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8ac4da05-b9dd-4f15-9640-11ef9977c5f8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090321 Sep 01 08:24:27.409809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1107/2240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:27 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:27.459717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:27.467236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95ca1436-5d15-434f-bedd-2d12a719d388 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082757 Sep 01 08:24:27.467790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1134/2241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:27 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:27.477737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:27.478398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:27.484316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.484790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.485218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.485885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.486351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.486764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.548696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:27.556680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:27.558092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:27.559202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46ac3568-ff7c-4176-8c5e-5980a67ffab9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085286 Sep 01 08:24:27.559747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1108/2242] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:27 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:27.960550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:27.961166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:27.967056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.967524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.967949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:27.968648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:27.969087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:27.969499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.032655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.041807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bdbc7f88-fed8-4a78-9a16-bc50ad676624 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085993 Sep 01 08:24:28.042417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1135/2243] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:27 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:28.110744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:28.111350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:28.118054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.118561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.118995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.119691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.120120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.120546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.168758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:28.169360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:28.175163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.175647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.176858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.177628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.178073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.178513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.181698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.189290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b920083c-41c8-4646-bf21-93214e5acad3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082324 Sep 01 08:24:28.189786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1109/2244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:28 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:28.240876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.248811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1410033a-a8e7-4669-a3f3-ab682d8d94b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083697 Sep 01 08:24:28.249624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1136/2245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:28 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:28.430585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:28.431239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:28.437420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.437908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.438375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.439091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.439594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.439960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.489735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:28.490360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:28.496511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.496997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.497419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.498104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.498570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.498992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.506377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.514401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b768d2b-8ba4-4ec9-b986-25188ffb4aec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087683 Sep 01 08:24:28.515301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1110/2246] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:28 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:28.560266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.568839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-78409135-902f-41bb-b688-ba0b0981b1e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083640 Sep 01 08:24:28.569409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1137/2247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:28 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:28.581053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:28.581657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:28.588037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.588516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.588946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.589624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:28.590072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:28.590526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:28.650589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.658519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.659947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:28.661665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fe544962-b97e-4a22-80ab-a8c24e4de52d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084609 Sep 01 08:24:28.662215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1111/2248] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:28 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:29.063276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:29.063886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:29.070437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.070912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.071345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.072012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.072456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.072873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.132552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.140051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a760453-70f4-4c53-94d6-fc0ed3477067 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080600 Sep 01 08:24:29.140613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1138/2249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:29 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:29.211221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:29.211829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:29.217781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.218283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.218727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.219409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.219860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.220281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.270730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:29.271334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:29.277476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.277952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.278408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.279094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.279537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.279953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.283115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.291917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e0c9fc3b-f5b2-4b8b-a27a-2dd77d0dbb0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085391 Sep 01 08:24:29.292483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1112/2250] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:29 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:29.342412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.350422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3ec18d39-7f7a-42d1-a0b1-b061b66e6b93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083899 Sep 01 08:24:29.351002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1139/2251] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:29 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:29.535989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:29.536712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:29.542943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.543433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.543859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.544548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.544991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.545405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.589393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:29.590061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:29.596615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.597112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.598532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.599310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.599767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.600185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.608506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.617502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-952ebd90-de35-4c30-acf8-56328f2ffbd6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085881 Sep 01 08:24:29.618090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1113/2252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:29 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:29.664606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.672448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b75da50d-e8a2-4c78-a199-e2391a759f2c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086943 Sep 01 08:24:29.673021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1140/2253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:29 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:29.686777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:29.687389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:29.694130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.694673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.695105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.695801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:29.696245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:29.696668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:29.764864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.773795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.775285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:29.776377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4841017f-4e0c-4998-8e35-704c5d8ea850 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093592 Sep 01 08:24:29.776937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1114/2254] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:29 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:30.164994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:30.165618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:30.171564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.172035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.172467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.173135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.173577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.173992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.234321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.241815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-202db550-bfb4-456e-baa9-c13123ecca25 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080652 Sep 01 08:24:30.242390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1141/2255] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:30 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:30.314517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:30.315117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:30.321515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.321984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.322456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.323124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.323570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.323982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.370807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:30.371503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:30.377455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.378012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.378594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.380961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.384004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.386028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.387766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.395932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9c82f9f5-79d4-4252-9b37-9854ee2e2415 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085079 Sep 01 08:24:30.396520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1115/2256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:30 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:30.449926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.458880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-94f225ef-46c1-4dcd-9eac-68c7a6c66fce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.091498 Sep 01 08:24:30.459466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1142/2257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:30 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:30.639298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:30.639898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:30.646332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.646835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.647244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.647929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.648379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.648796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.695286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:30.695894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:30.697826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:30.703169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.703652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.704190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.704881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.705345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.705761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.714492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.721986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e0298f0b-3bea-4514-a9e5-d311bd403575 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086539 Sep 01 08:24:30.722624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1116/2258] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:30 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:30.766626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.768790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:30.775312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7f82ae30-4500-436b-a4bc-fe5b7ab71ff9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084818 Sep 01 08:24:30.775863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1143/2259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:30 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:30.798876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:30.799483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:30.806009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.806534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.806965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.807677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:30.808102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:30.808556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:30.871604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.880353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.881767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:30.882882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e4b46bbe-18df-4ada-bf2a-3041ee5ea226 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087837 Sep 01 08:24:30.883433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1117/2260] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:30 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:31.262564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:31.263186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:31.269566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.270099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.270551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.271220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.271663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.272078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.332622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.340485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40f75db0-9de1-43a4-932e-08f9183b5c4e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081794 Sep 01 08:24:31.341037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1144/2261] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:31 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:31.417346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:31.417976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:31.423886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.424364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.424796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.425469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.425913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.426361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.479415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:31.480017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:31.485885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.486385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.487344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.487476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.487918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.488977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.489988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.497699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-58f6be59-e1a6-41a0-a9d6-8524c8ab9976 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084131 Sep 01 08:24:31.498351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1118/2262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:31 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:31.552094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.559923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f0be0b2-ba53-4658-ae00-34cc8f9bf2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084255 Sep 01 08:24:31.560488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1145/2263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:31 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:31.743222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:31.744113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:31.749808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.750313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.750840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.751441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.751886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.752302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.772273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:31.795997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:31.796609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:31.803527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.803925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.804356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.805040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.805481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.805895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.817408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.825885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4f097588-c4fd-4e73-8b1d-81a1518074fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086666 Sep 01 08:24:31.826770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1119/2264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:31 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:31.868212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.876380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb65f51c-88c0-48fd-a603-1f05b333e4ad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084353 Sep 01 08:24:31.876957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1146/2265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:31 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:31.905284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:31.906016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:31.912750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.913227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.913666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.914381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:31.914834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:31.915252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:31.979935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.988541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.990775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:31.991818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c852afe2-2e16-45ec-8439-3f76afd6483e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090366 Sep 01 08:24:31.992705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1120/2266] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:31 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:32.361500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:32.362099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:32.368185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.368653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.369077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.369748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.370191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.370630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.433345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:32.442369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8cea6f9a-fa65-450d-a06f-e49c6cd1b1d3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084495 Sep 01 08:24:32.442944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1147/2267] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:32 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:32.519026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:32.520220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:32.526193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.526713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.527132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.527809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.528261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.528679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.581168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:32.581816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:32.588269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.588750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.589180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.589870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.589976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:32.590342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.590773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.599389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80af4807-4cc5-4778-b75b-c2168818282d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083364 Sep 01 08:24:32.600103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1121/2268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:32 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:32.653558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:32.661946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6fc1fdcc-ce46-4c8f-9846-f32d414b3c50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084515 Sep 01 08:24:32.662546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1148/2269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:32 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:32.848556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:32.849194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:32.851297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:24:32.851488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:24:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 (ip 10.222.0.43) !!! Sep 01 08:24:32.857251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.857737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.858172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.858932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.859381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.859800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.897603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:32.898391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:32.904614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.905093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.905534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.906227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:32.906709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:32.907132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:32.927361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:32.935689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-904c106e-85fa-45de-9d54-6c8f92e048be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091776 Sep 01 08:24:32.936261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1122/2270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:32 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:32.969856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:32.978242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b46a0ac8-368d-4144-85ed-a5072e60ed47 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085101 Sep 01 08:24:32.978827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1149/2271] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:32 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:33.017092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:33.017690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:33.024583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.025074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.025509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.026198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.026670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.027092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.091458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:33.100348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:33.101948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:33.103011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-de1aa8d4-7cfd-4848-a3d4-d1e3301996cf tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089746 Sep 01 08:24:33.103478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1123/2272] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:33 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:33.464141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:33.464703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:33.470895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.471681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.471797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.473148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.473805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.474231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.533999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:33.543099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cbbcb24d-a3e3-49da-b82d-8adf81785c2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082802 Sep 01 08:24:33.543662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1150/2273] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:33 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:33.619694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:33.620284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:33.626087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.626586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.627013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.627679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.628120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.628534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.682251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:33.683071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:33.689089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.689527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.689978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.690680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.691130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.691393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:33.691533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.699105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-614d7bf2-9a49-45dd-8f1c-f2ec57fab4fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083177 Sep 01 08:24:33.699670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1124/2274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:33 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:33.756074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:33.763684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-69c3f2c3-94ea-43e3-b167-1b494e27b37a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085284 Sep 01 08:24:33.764256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1151/2275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:33 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:33.960918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:33.962018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:33.971214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.971703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.972134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.973577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:33.974306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:33.974496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:33.999077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:33.999694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:34.006328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.006727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.007161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.007857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.008308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.008739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.044678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.053459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1bcc2700-bae9-479c-9d06-73b6b77cd579 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.100333 Sep 01 08:24:34.054024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1125/2276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:33 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:34.075634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.084474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8471a025-1650-4bc4-b2a2-a2c73647f87a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.089217 Sep 01 08:24:34.085043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1152/2277] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:33 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:34.124841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:34.125435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:34.131632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.132110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.132538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.133217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.133659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.134073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.199314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.208425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.210020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.211166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-05628613-dc3c-431d-ac1d-ac0e79650743 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090127 Sep 01 08:24:34.211724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1126/2278] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:34 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:34.563864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:34.564465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:34.571222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.571742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.572166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.572849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.573292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.573707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.633967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.641497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac701ad0-7edb-4531-94b7-ae4cf079c2aa tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081528 Sep 01 08:24:34.642053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1153/2279] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:34 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:34.719253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:34.719852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:34.726015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.726526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.726962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.727641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.728088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.728506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.784390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:34.785005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:34.788772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.791708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.792189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.792618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.793305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:34.793755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:34.794172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:34.796485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2015015d-987b-4f47-a1c1-91e9e68c9646 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081038 Sep 01 08:24:34.797048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1127/2280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:34 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:34.856047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:34.863957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-427a3313-1536-426e-8617-bcd9a9721e35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083343 Sep 01 08:24:34.864546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1154/2281] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:34 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:35.074976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:35.075605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:35.081854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.082587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.083033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.084095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.084549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.084972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.106676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:35.107436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:35.115010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.115527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.116122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.116906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.117416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.117836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.154203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.162800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0208589-f9f3-436e-ab89-bc2bd300b9b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091548 Sep 01 08:24:35.163376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1128/2282] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:35 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:35.182413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.190011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b270299-b3bc-4451-8aab-fb4df5f27df8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088257 Sep 01 08:24:35.190593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1155/2283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:35 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:35.234359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:35.234957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:35.236809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:35.243318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.243804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.244241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.244926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.245369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.245785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.308205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.318553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.319991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.321114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bdc2dde2-1de8-4340-949c-bb66e439ff0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090660 Sep 01 08:24:35.321669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1129/2284] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:35 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:35.663024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:35.663623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:35.669555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.670021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.670480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.671152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.671594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.672009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.735644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.743735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2093c80f-e1bf-462c-a465-a2f483154e75 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085062 Sep 01 08:24:35.744284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1156/2285] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:35 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:35.816769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:35.817376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:35.824225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.824707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.825139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.825822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.826293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.826717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.885555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:35.886296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:35.889856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.892837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.893407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.893911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.894701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:35.895221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:35.895649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:35.897504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0dd26ef6-414b-40e3-8e19-afa31a804e1b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.084536 Sep 01 08:24:35.898053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1130/2286] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:35 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:35.957475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:35.965579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-395da13e-a6af-44f8-a10a-153295c27ab2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083755 Sep 01 08:24:35.966153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1157/2287] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:35 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:36.183769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:36.184366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:36.190520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.190999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.191429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.192122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.192568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.193043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.211537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:36.212415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:36.218283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.218775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.219209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.219897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.220344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.220760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.259343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:36.267734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-08e39da4-5e5a-4356-abb6-5184ae42b500 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087750 Sep 01 08:24:36.268510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1131/2288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:36 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:36.285909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:36.294229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd007865-fd55-4350-9cb7-756571107bc8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087359 Sep 01 08:24:36.294803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1158/2289] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:36 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:36.344242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:36.344994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:36.351599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.352341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.352496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.353171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.353612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.354025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.423908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:36.432608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:36.434026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:36.435135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f5ba8f23-141a-469b-bdcb-8718e0f7b8e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094808 Sep 01 08:24:36.435679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1132/2290] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:36 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:36.766142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:36.766704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:36.772619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.773091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.773523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.774206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.774677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.775094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.835062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:36.842524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-49533ed1-e400-4203-96a9-cd8fcdc7dbba tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080339 Sep 01 08:24:36.843083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1159/2291] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:36 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:36.918342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:36.918961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:36.924864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.925341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.925770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.926478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.926928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.928006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.986671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:36.987358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:36.988185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:36.995294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.995776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.996200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.996885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:36.997322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:36.997609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6cf74cfc-d97f-4188-8b0b-56b9769ccddc tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083067 Sep 01 08:24:36.997720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:36.998194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1133/2292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:36 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:37.014522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:37.061769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:37.069447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7a19a89-5b72-4911-b093-a1e9f667b8e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086718 Sep 01 08:24:37.070024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1160/2293] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:36 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:37.289632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:37.290237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:37.296403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.296883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.297313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.298006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.298483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.298907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.315344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:37.315861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:37.322052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.322563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.322990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.323675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.324116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.324534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.372503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:37.380232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4b1d7c79-e904-4e9d-b26a-d01dc63d8850 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095154 Sep 01 08:24:37.380831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1134/2294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:37 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:37.398431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:37.406013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-932c72c8-ab66-4ca1-8267-2f8e7c4db300 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.094651 Sep 01 08:24:37.406599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1161/2295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:37 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:37.457140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:37.457741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:37.464599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.465076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.465520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.466211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.466685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.467105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.529823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:37.538551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:37.540038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:37.541224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-426b0bd2-bc99-4994-acdd-bdb3a930f242 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088015 Sep 01 08:24:37.541775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1135/2296] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:37 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:37.863752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:37.864366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:37.870628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.871115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.871684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.872421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:37.872939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:37.873479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:37.934683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:37.942345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-55a46be8-d156-4722-85f4-fd5ce6eb0053 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082431 Sep 01 08:24:37.943548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1162/2297] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:37 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:38.019298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:38.020036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:38.026077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.026584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.027009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.027682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.028120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.028560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.032373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:38.088570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:38.089919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:38.090546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:38.096228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-196c2c44-ce53-4e71-bfca-4c1470be34a3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.080910 Sep 01 08:24:38.096697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.097104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1136/2298] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:38 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:38.097266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.097769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.098493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.098971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.099645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.164667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:38.175770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f79f7b90-7a68-4f2d-b4e0-4ef601f3f092 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089672 Sep 01 08:24:38.176349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1163/2299] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:38 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:38.403921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:38.404586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:38.410850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.411396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.411862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.412683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.413159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.413588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.427513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:38.428119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:38.434354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.434984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.435414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.436103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.436548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.441258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.489442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:38.500400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-660ca2c9-0e59-4f4e-925d-43790cc449e6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.100095 Sep 01 08:24:38.501136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1137/2300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:38 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:38.510535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:38.518431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e4d22a8d-332a-4678-afe9-9a9fbeee39b1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.094811 Sep 01 08:24:38.519395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1164/2301] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:38 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:38.563987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:38.564583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:38.571147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.571660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.572090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.572786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.573264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.573690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.635978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:38.644057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:38.645479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:38.647175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf59f4bc-17e8-4d5f-a0bb-ec0ebef40284 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087096 Sep 01 08:24:38.647732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1138/2302] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:38 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:38.964303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:38.964886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:38.970733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.971208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.971637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:38.972307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:38.972749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:38.973169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.035883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.043416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b80fc743-6140-4261-a372-9b9475947ec2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082983 Sep 01 08:24:39.043975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1165/2303] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:38 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:39.116056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:39.116690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:39.122609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.123089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.123514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.124194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.124640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.125056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.183952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.191428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6bdd8c6c-c55a-4e32-8120-86bf7834a223 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.079306 Sep 01 08:24:39.191982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1139/2304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:39 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:39.196965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:39.197569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:39.203635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.204198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.204737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.205428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.205981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.206416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.267232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.275752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-87d3a101-0889-414c-aaf4-8e9db3011bcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083089 Sep 01 08:24:39.276324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1166/2305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:39 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:39.521216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:39.521800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:39.527814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.528320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.528747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.529430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.529880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.530311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.539008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:39.539624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:39.545758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.546245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.546711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.547416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.551902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.551902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.602819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.610413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e9663d0-5388-4b30-a3d0-1adbaaa5e369 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.093116 Sep 01 08:24:39.610980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1140/2306] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:39 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:39.622375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.630186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b991d7a9-0634-44e6-a48a-f2aaf82a0741 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095349 Sep 01 08:24:39.631404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1167/2307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:39 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:39.670659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:39.671282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:39.677770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.678246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.678782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.679463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:39.679910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:39.680325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:39.744321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.752447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.753869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:39.754987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-df2231dc-bffc-4b5b-a5a4-dabbc12811ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088438 Sep 01 08:24:39.756221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1141/2308] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:39 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:40.064799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:40.065500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:40.071313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.071787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.072213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.072888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.073332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.073745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.133576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.141475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9c365b2-2d5a-47d2-8b6b-09d1f068c850 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080727 Sep 01 08:24:40.142048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1168/2309] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:40 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:40.212893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:40.213496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:40.219444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.219969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.220401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.221077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.221523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.221938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.291497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.296016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:40.296622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:40.299191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-254442c7-cc31-4b40-b69d-ea84b765c5be tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.090848 Sep 01 08:24:40.299758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1142/2310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:40 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:40.302860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.303416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.303918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.304667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.305203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.305700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.367887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.375602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6eedf3af-f73f-4b2b-9c4b-76dee63a8590 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083287 Sep 01 08:24:40.376176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1169/2311] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:40 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:40.632223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:40.632796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:40.638955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.639442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.639867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.640553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.641003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.641417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.651492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:40.652096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:40.658337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.658820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.659249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.659930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.660382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.660800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.716619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.725328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aa8644a8-2b9c-4ab6-beb7-5f027e99540d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.097408 Sep 01 08:24:40.726176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1143/2312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:40 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:40.745937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.753689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a5dbca1-7fec-41e7-93bc-ef8868c5e4c6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.105989 Sep 01 08:24:40.754228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1170/2313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:40 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:40.782425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:40.783519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:40.790825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.791309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.791740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.792427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:40.792875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:40.793299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:40.857304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.865799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.867275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:40.868379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f6b7edb1-4c4b-4866-aaae-08d10dc2759d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093317 Sep 01 08:24:40.868937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1144/2314] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:40 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:41.163081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:41.163705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:41.169716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.170187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.170904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.171585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.172029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.172444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.231815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.240777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e52d7c4c-7b47-4e31-b706-7d0e6a97360a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081594 Sep 01 08:24:41.241335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1171/2315] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:41 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:41.319655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:41.320261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:41.326213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.326720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.327150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.327829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.328285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.328694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.389430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.396746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:41.397347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:41.397472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-01f4ac54-d678-48db-a787-f1ba8d13bf27 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081685 Sep 01 08:24:41.397932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1145/2316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:41 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:41.403149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.403622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.404062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.404723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.405161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.405571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.471261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.480627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0e47f97c-e9bc-4e35-8a85-45983e2ab6b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087771 Sep 01 08:24:41.481193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1172/2317] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:41 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:41.746202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:41.746791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:41.752893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.753377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.753812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.754530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.754981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.755695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.775699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:41.776299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:41.782235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.782745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.783234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.784001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.784463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.784886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.834846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.842413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f80b9681-171c-4f2f-b35b-2b02d7613fc5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.100127 Sep 01 08:24:41.842994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1146/2318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:41 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:41.853992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.862230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7c3ee059-3bb6-4db0-b25c-e9e6686bce20 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090283 Sep 01 08:24:41.862834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1173/2319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:41 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:41.891176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:41.891811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:41.897816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.898324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.898758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.899434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:41.899881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:41.900298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:41.961847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.970035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.971531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:41.972625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e2c3a79f-81bc-4d4a-a5b5-9d7eb4331afc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085314 Sep 01 08:24:41.973166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1147/2320] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:41 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:42.261113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:42.261720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:42.267613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.268086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.268515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.269189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.269631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.270048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.328829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:42.336805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9d7b2ba-3191-4c25-aa47-14fa83855f35 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079522 Sep 01 08:24:42.337364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1174/2321] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:42 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:42.418338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:42.418965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:42.424843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.425321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.425750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.426460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.426903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.427350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.490599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:42.498461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d00bb53b-69e7-4d6d-9ea5-f3bae7689eb3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.083919 Sep 01 08:24:42.499047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1148/2322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:42 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:42.500611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:42.501217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:42.507301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.507780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.508335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.509019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.509463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.509940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.571764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:42.579615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed81437a-1459-49e7-abe2-27d5350dd90d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082575 Sep 01 08:24:42.580190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1175/2323] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:42 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:42.862880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:42.863429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:42.870310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.870788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.871279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.872119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.872618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.873124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.883731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:42.884732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:42.890876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.891358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.891787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.892500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:42.892916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:42.893337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:42.943550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:42.951139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-232c257d-a0da-49ee-9e63-dd8d9a6e225c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.092226 Sep 01 08:24:42.951709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1149/2324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:42 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:42.963004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:42.970637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20d953f2-5195-478d-b4bc-51e765039875 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090695 Sep 01 08:24:42.971204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1176/2325] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:42 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:42.995845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:42.996440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:43.003545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.003934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.004536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.005230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.005678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.006093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.070014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:43.077996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:43.079572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:43.080653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-53e1ef1b-a461-453b-b963-533204c25463 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088683 Sep 01 08:24:43.081195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1150/2326] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:42 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:43.357413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:43.358020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:43.363941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.364422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.364900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.365585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.366039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.366489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.369016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:43.431907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:43.439634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3a837287-d95c-4359-ba65-ef811df8c1d2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085953 Sep 01 08:24:43.440193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1177/2327] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:43 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:43.519766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:43.520367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:43.526954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.527426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.527851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.528524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.528960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.529375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.590542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:43.598196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5cd9b726-a8a8-47c2-b9f7-ff7d5fc89b5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082166 Sep 01 08:24:43.598783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1151/2328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:43 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:43.600109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:43.600711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:43.606779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.607353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.607904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.608551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.609119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.609543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.669183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:43.676756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e6c02b89-eeef-4d6f-86cb-1630aa4ae05c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080507 Sep 01 08:24:43.677364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1178/2329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:43 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:43.972127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:43.972690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:43.979463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.979937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.980358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.981036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.981474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.981884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:43.991731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:43.992338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:43.998488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:43.998974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:43.999430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.000156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.000604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.001025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.057901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.061434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:44.066921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-64a15c74-3b35-4ab0-9234-9cb3a67b564a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.098588 Sep 01 08:24:44.067768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1152/2330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:43 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:44.080026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.088611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d16b1777-1daf-480f-8075-68af6b59d6d6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100684 Sep 01 08:24:44.089188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1179/2331] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:43 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:44.104147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:44.104746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:44.110934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.111419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.111845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.112538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.112985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.113403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.174162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.182407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.183823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.184897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-362cf3ed-2d76-48c6-903c-c86d1c450837 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084715 Sep 01 08:24:44.185438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1153/2332] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:44 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:44.462386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:44.463644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:44.469621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.470098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.470559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.471238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.471681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.472388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.531087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.539325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5bd572cf-6ed9-4279-91c4-64d6ea669e2d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081778 Sep 01 08:24:44.543139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1180/2333] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:44 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:44.619795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:44.620297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:44.626138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.626647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.627078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.627753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.628199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.628618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.688155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.695795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-759ad07b-55b5-49a3-9670-16c354157c89 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.079882 Sep 01 08:24:44.696361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1154/2334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:44 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:44.697053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:44.697623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:44.703477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.703945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.704368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.705038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:44.705475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:44.705885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:44.769432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:44.777765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0243c3c2-5db1-4a53-a183-b5f3d9cc9f38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084430 Sep 01 08:24:44.778396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1181/2335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:44 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:45.087959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:45.088548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:45.094593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.095069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.095492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.096169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.096605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.097026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.110554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:45.111156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:45.119340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.119826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.120252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.121238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.121377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.121946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.162118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.170472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4b5580ce-3834-4475-bbbc-6e812b536718 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086239 Sep 01 08:24:45.171063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1155/2336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:45 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:45.191765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.200056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cb9e5c41-404f-4a50-b14c-6d0910cd6e06 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093229 Sep 01 08:24:45.200630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1182/2337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:45 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:45.208487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:45.209133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:45.215408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.215886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.216317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.217012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.217456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.217877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.280981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.289083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.290516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.291603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-05abba01-acce-4935-9d10-725aed0dd097 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087485 Sep 01 08:24:45.292161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1156/2338] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:45 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:45.560677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:45.561286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:45.567183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.568397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.569111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.569806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.570281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.570724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.634296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.641822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2690c5ac-9fe7-4398-8b38-8584b2b50ce6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084989 Sep 01 08:24:45.642397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1183/2339] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:45 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:45.716681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:45.717305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:45.723417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.723841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.724266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.724936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.725376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.725790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.784750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.792840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93387c12-83a9-4e12-b085-c2640f910b55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.079899 Sep 01 08:24:45.793358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1157/2340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:45 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:45.797586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:45.798198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:45.804991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.805474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.805932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.806644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:45.807096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:45.807520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:45.871006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:45.878901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-92e0fe7d-f51c-4204-8f64-c7bbf89765f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085111 Sep 01 08:24:45.879478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1184/2341] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:45 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:46.191565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:46.192155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:46.198102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.198629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.199052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.199732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.200172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.200581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.221242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:46.221852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:46.228890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.229348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.229774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.230487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.230936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.231354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.264105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.272852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2ec61f1a-eeb1-4d40-9121-3ab94271a7be tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084998 Sep 01 08:24:46.273730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1158/2342] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:46 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:46.297071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.304844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30e4bb74-83a7-4ce4-bfc4-d5c1e2400d43 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087630 Sep 01 08:24:46.305417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1185/2343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:46 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:46.314419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:46.315053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:46.321518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.322003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.322469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.323166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.323611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.324026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.386616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.394598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.396537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.397616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aef03a12-3c47-4020-8fa7-83cfec04c2eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087104 Sep 01 08:24:46.398163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1159/2344] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:46 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:46.661195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:46.661929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:46.667838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.668311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.668732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.669401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.669845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.670272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.728967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.736464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ec31d7a-ddc5-477a-85cf-6119f50cfea4 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079083 Sep 01 08:24:46.737016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1186/2345] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:46 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:46.813505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:46.814102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:46.820502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.820970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.821422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.822093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.822572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.822987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.883478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.891240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1e8d90e-0dbb-42b5-b68b-7fae1ed85675 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.081558 Sep 01 08:24:46.891800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1160/2346] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:46 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:46.900833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:46.901441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:46.907353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.907830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.908260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.908942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:46.909395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:46.909814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:46.972629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:46.980924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2c520229-efd7-401d-b74c-af5b10020cf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083785 Sep 01 08:24:46.981418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1187/2347] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:46 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:47.293905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:47.294551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:47.300743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.301225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.301683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.303083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.303559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.304006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.326112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:47.326745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:47.332999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.334198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.334667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.335355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.335807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.336226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.367784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:47.376010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bb85be0a-6bb5-4440-93bf-feb34bf61d16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085989 Sep 01 08:24:47.376578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1161/2348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:47 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:47.399693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:47.407376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28fe6978-ca83-4651-b4ba-f26a8d1f5c9a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085083 Sep 01 08:24:47.407938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1188/2349] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:47 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:47.420764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:47.421364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:47.428055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.428533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.428963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.429648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.430089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.430534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.493011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:47.500991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:47.502435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:47.503508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-41ebec58-5d2e-45e3-a45b-8b23d5d541be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086638 Sep 01 08:24:47.504052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1162/2350] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:47 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:47.756824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:47.757368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:47.763238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.763712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.764137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.764806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.765245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.765658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.829197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:47.838589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c77e5653-058e-4b7d-a0ae-09d4b9d20259 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085616 Sep 01 08:24:47.839146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1189/2351] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:47 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:47.913513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:47.914114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:47.920053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.920529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.920964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.921636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:47.922083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:47.922544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:47.983924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:47.991747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5cb470a6-3a84-4e70-b57f-18e255981d2f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.082791 Sep 01 08:24:47.992312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1163/2352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:47 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:48.002281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:48.002985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:48.010186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.010635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.011070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.011754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.012211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.012627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.075503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:48.086365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4af146fd-127f-4152-af08-9d0649159f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084876 Sep 01 08:24:48.086956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1190/2353] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:47 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:48.396332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:48.397141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:48.403209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.403692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.404126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.404814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.405262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.405689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.429235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:48.429849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:48.435917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.436398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.437337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.438307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.438948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.439566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.470936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:48.477503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ae675b74-da3e-48f5-bd47-2fbab6b79646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085501 Sep 01 08:24:48.478078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1164/2354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:48 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:48.512252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:48.520468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f222c3d5-e83c-4c46-b0c5-5629eecfa038 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095554 Sep 01 08:24:48.521598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1191/2355] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:48 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:48.525774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:48.526400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:48.533059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.533769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.534195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.534911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.535353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.535792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.598575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:48.606588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:48.608008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:48.609130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d2c2d871-8ee0-4ed4-8e2d-eb3b0630b7b8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087411 Sep 01 08:24:48.609624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1165/2356] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:48 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:48.859893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:48.860419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:48.867102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.867581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.868009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.868683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:48.869128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:48.869548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:48.930601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:48.938136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d4508d2a-32c4-4605-abc4-f0bc81ed6ba8 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082183 Sep 01 08:24:48.938744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1192/2357] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:48 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:49.011498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:49.012099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:49.017963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.018476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.018910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.019588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.020037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.020458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.079290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:49.087162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c5545f89-1b4f-415b-9565-fb53373c5743 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.079491 Sep 01 08:24:49.087745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1166/2358] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:49 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:49.111873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:49.112400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:49.114223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:49.119957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.120435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.120863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.121544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.121992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.122446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.184565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:49.186765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:49.193918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a2c53571-ce1e-4fb4-9d69-43edaca7fa76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085899 Sep 01 08:24:49.194525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1193/2359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:49 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:49.498447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:49.499053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:49.505572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.506059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.506546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.507236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.507685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.508107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.542318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:49.542927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:49.549343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.549829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.550285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.550981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.551432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.552609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.570796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:49.579323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d329ff58-f4e4-4465-b34d-b4385c8ae652 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084731 Sep 01 08:24:49.580277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1167/2360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:49 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:49.616111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:49.624031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7d38e7d-def6-4f53-bbaa-8ced4a5e3dd1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085881 Sep 01 08:24:49.624593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1194/2361] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:49 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:49.632644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:49.633258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:49.639325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.639806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.640269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.640991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.641441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.641961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.703469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:49.711678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:49.713093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:49.714164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-114f4e46-f6d0-48a4-bf4f-86f4dfe3c957 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085611 Sep 01 08:24:49.714738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1168/2362] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:49 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:49.959478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:49.960070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:49.966765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.967323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.967745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:49.968416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:49.968858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:49.969271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.030975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.039604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ec23f58f-0dc7-46a2-b687-d2ce25827436 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084681 Sep 01 08:24:50.040625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1195/2363] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:49 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:50.107915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:50.108535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:50.114781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.115259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.115683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.116358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.116799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.117520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.135996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:50.215370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:50.215898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:50.222016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.222551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.222977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.223672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.224697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.225110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.324971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.333975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-64ac2c5c-cd8e-409d-ac15-226ea3403bad tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.228789 Sep 01 08:24:50.334591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1169/2364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:50 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:50.351993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.359829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b242af6a-d38d-4255-b499-7b8ae36dd348 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.148373 Sep 01 08:24:50.360401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1196/2365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:50 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:50.601557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:50.602158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:50.608418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.608887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.609318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.610000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.610496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.610936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.644208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:50.644815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:50.651740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.652230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.652662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.653371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.653821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.654240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.672998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.689576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bae143c9-d7c9-4ea6-8e40-df0996450607 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.092421 Sep 01 08:24:50.690377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1170/2366] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:50 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:50.717851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.728822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3131789-0f08-44d5-a120-7722cd0da79d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088365 Sep 01 08:24:50.729315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1197/2367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:50 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:50.737456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:50.738056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:50.744794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.745271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.745700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.746435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:50.746882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:50.747302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:50.811082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.819159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.820560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:50.821634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-177e0cab-4b8b-48ad-bccd-d0c3312d6b8e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088029 Sep 01 08:24:50.822176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1171/2368] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:50 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:51.060817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:51.061397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:51.067548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.067926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.068366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.069040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.069483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.069898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.135454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.143171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-af679266-0b78-4bec-8bbb-eaa6f2f59434 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086144 Sep 01 08:24:51.143853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1198/2369] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:51 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:51.355461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:51.355981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:51.362059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.362575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.363009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.363718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.364204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.365307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.380381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:51.381013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:51.387127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.387606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.388038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.388725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.389172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.389595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.429073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.436964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d666b171-7701-4bc8-ba8b-037f7d8593e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.085395 Sep 01 08:24:51.437548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1172/2370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:51 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:51.456979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.465418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f10caa86-e068-46b0-88d6-89c195f1aeb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089150 Sep 01 08:24:51.466002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1199/2371] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:51 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:51.710367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:51.710928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:51.716780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.717253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.717676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.718371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.718812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.719229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.750866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:51.751472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:51.758341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.758827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.759265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.759960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.760412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.760838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.799178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.808132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0618ce41-7dcd-42ad-bd67-d79f2a1bdff4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.101798 Sep 01 08:24:51.808735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1173/2372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:51 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:51.835164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.843348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e9e8082-4997-4e20-81b4-c968edffd0ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.096221 Sep 01 08:24:51.844255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1200/2373] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:51 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:51.845018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:51.845603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:51.852564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.853046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.853484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.854177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:51.854656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:51.855077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:51.917780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.925699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.927417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:51.928281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-077bb964-2bc5-46eb-a6c3-9d993ee5dc55 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087458 Sep 01 08:24:51.928844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1174/2374] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:51 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:52.162951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.163559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.169483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.169959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.170421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.171100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.171547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.171967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.231261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:52.238825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0f0cb666-0693-4ff3-8936-784cc2598c0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079812 Sep 01 08:24:52.239927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1201/2375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:52 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:52.461184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.461738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.467891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.468365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.468791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.469471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.469917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.470369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.490926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.492058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.502758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.503637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.504419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.506249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.507118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.507913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.534847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:52.543932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c21d1357-916d-4bf9-95be-46be44e068a8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 200 len: 1222 microversion: 2.1 time: 0.086755 Sep 01 08:24:52.544511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1175/2376] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:52 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:52.564324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.564810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.570970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.571456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.571909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.572583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.573029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.573447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.575541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:52.584237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d3b7d846-b254-4015-ab6d-530458246305 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.101095 Sep 01 08:24:52.584815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1202/2377] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:52 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:52.602402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:24:52.612512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.613122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.613733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.628059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lazy-loading 'flavor' on Instance uuid 2b8be9c5-dd6a-4204-8476-0571e8d41e94 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:24:52.640060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lazy-loading 'system_metadata' on Instance uuid 2b8be9c5-dd6a-4204-8476-0571e8d41e94 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:24:52.657027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lazy-loading 'metadata' on Instance uuid 2b8be9c5-dd6a-4204-8476-0571e8d41e94 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:24:52.770167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Deleted allocations for instance 2b8be9c5-dd6a-4204-8476-0571e8d41e94 Sep 01 08:24:52.772190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:52.789427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b7329f0e-56ba-44e5-b708-6b6f57969bca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 204 len: 0 microversion: 2.1 time: 0.228825 Sep 01 08:24:52.790330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1176/2378] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:24:52 2022] DELETE /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 08:24:52.799000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.799603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 2b8be9c5-dd6a-4204-8476-0571e8d41e94] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.806776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.807286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.807737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.808430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.808874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.809293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.822641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] HTTP exception thrown: Instance 2b8be9c5-dd6a-4204-8476-0571e8d41e94 could not be found. Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Request method failure captured: Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 HTTP/1.1 Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGrp95DNXTaENj1SEcTN7CWAN6Gejzun8V0WqDYttTUcwvw9UnXAxrfa_aojN07OHmKMTmwcfEIZmGuMxVhmm16GRrW-uPnaIz_JXH75CMRzszfhylVLOE7DOwRdzAn-mJIC1nWKTXfNhbJp5Y0ugssn85xRSVARnx1ozTP4_x8Qt6g Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 82d7e2503aa043929798769c22c1b2da Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1497783886 Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:24:52.824160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7e2503aa043929798769c22c1b2da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7e2503aa043929798769c22c1b2da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82d7e2503aa043929798769c22c1b2da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82d7e2503aa043929798769c22c1b2da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesSnapshotTestJSON-1497783886 Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 82d7e2503aa043929798769c22c1b2da Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1497783886 Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesSnapshotTestJSON-1497783886-project Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: d713712c30574895b82beedb9c4f251d Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesSnapshotTestJSON-1497783886-project Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance 2b8be9c5-dd6a-4204-8476-0571e8d41e94 could not be found. Sep 01 08:24:52.825751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '2b8be9c5-dd6a-4204-8476-0571e8d41e94'} Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8be9c5-dd6a-4204-8476-0571e8d41e94 could not be found. Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:24:52.826865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8be9c5-dd6a-4204-8476-0571e8d41e94 could not be found. Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8be9c5-dd6a-4204-8476-0571e8d41e94 could not be found. Sep 01 08:24:52.828413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:24:52.829745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Returning 404 to user: Instance 2b8be9c5-dd6a-4204-8476-0571e8d41e94 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:24:52.829745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03ddab56-a87e-4b80-ac99-192df82c6ecd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94" status: 404 len: 111 microversion: 2.1 time: 0.030371 Sep 01 08:24:52.829745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1203/2379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:52 2022] GET /compute/v2.1/servers/2b8be9c5-dd6a-4204-8476-0571e8d41e94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:24:52.829996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.829996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.837319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.837890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.838361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.839054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.839511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.840053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.869564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.870169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.877580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.878058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.878513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.879203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.879647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.880732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.908810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:52.921092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8f902013-6531-4ca8-a5f3-fcf4149b9583 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095949 Sep 01 08:24:52.921904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1177/2380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:52 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:52.950919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:52.955413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:52.955413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:52.959486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9765e7a7-7f40-404c-8013-680807e3eee9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095408 Sep 01 08:24:52.964018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1204/2381] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:52 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:52.967204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.967700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.968137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:52.968854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:52.969848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:52.970236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.041182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:53.049364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:53.050832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:53.052501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3215b038-ed0e-4c05-a1ab-e32fcac1056c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.105129 Sep 01 08:24:53.066292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1178/2382] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:52 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:53.260580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:53.261191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:53.268638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.269056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.269475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.270165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.271005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.271539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.333610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:53.341383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ef45282c-9cdc-4c01-bd9c-f9e7629236de tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084611 Sep 01 08:24:53.341941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1205/2383] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:53 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:53.605205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:53.605808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:53.611874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.612344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.612769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.613448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.613893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.614327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.676287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:53.684768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-50fe7595-b03f-4b5c-a192-7b68aca0be7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083330 Sep 01 08:24:53.685344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1179/2384] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:53 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:53.943448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:53.943969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:53.949893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.950400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.950830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.951505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.951951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.952378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.988816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:53.990092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:53.996550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.997038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.997468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:53.998158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:53.998632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:53.999050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:54.014823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:54.025821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-af0df2c3-a2bb-4bf1-b3d5-0aecc0fa80b6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086891 Sep 01 08:24:54.026457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1206/2385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:53 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:54.073725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:54.076519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:54.077131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:54.081765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a61406ad-df87-4f2a-91da-fb49f4a8f1d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.096623 Sep 01 08:24:54.082366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1180/2386] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:53 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:54.084068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:54.084558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:54.084993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:54.085696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:54.086344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:54.086778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:54.149267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:54.157359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:54.158809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:54.159885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fc49ed30-17e7-47f9-9626-be2d6c58e0ff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087479 Sep 01 08:24:54.160430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1207/2387] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:54 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:54.362301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:54.362301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:54.369269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:54.369740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:54.370168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:54.370873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:54.371315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:54.371733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:54.431202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:54.438813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aa93251e-603d-4c8f-bbe3-854640c8ce87 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.080881 Sep 01 08:24:54.439573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1181/2388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:54 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:54.705789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:54.706336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:54.713227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:54.713713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:54.714147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:54.714871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:54.715330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:54.715750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:54.778522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:54.786892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ba3f5ba4-2091-44ed-86cd-9dbe1cce5b7e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084395 Sep 01 08:24:54.787465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1208/2389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:54 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:55.046999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:55.047610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:55.054352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.054837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.055272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.055955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.056405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.056825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.060676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:55.115120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:55.116008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:55.122136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.122668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.122818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:55.123105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.123801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.124254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.124681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.131531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fe88e2a6-4578-49b7-96a2-dcc2dce8d309 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088292 Sep 01 08:24:55.132340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1182/2390] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:55 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:55.188923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:55.189550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:55.196102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.196594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.197032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.197733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.198181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.198443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:55.198771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.206446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-659fd18c-e056-45c0-a9f3-1d2ebf717941 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095913 Sep 01 08:24:55.207131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1209/2391] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:55 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:55.262145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:55.272041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:55.273458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:55.274604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6de04d8f-7a45-4ada-99f4-bc94d21a827f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092808 Sep 01 08:24:55.275157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1183/2392] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:55 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:55.460010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:55.460612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:55.466598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.467074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.467510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.468177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.468620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.469035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.530671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:55.538863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7716fb57-b5b9-4ba6-9691-6540c99a7ff6 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083465 Sep 01 08:24:55.539430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1210/2393] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:55 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:55.808575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:55.809180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:55.815186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.815659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.816109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.816767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:55.817208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:55.817627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:55.882513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:55.890703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-766d65e4-f24e-4c8b-8a61-7899b3227213 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086225 Sep 01 08:24:55.891270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1184/2394] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:55 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:56.152262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:56.152864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:56.158700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.159173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.159597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.160265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.160707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.161122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.164374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:56.226455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:56.231489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:56.232108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:56.235382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-866122cc-2df9-4bd3-b95a-3e1e0d85ab95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086849 Sep 01 08:24:56.236269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1211/2395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:56 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:56.243922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.243922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.243922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.243922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.244258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.244258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.297568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:56.298398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:56.304737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.305364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.305906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.306817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.307383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.307901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.309445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:56.317356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a7d97f80-75fc-4ef6-ac64-edc63bcf2e8d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090338 Sep 01 08:24:56.317930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1185/2396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:56 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:56.377188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:56.386701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:56.388174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:56.389258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52ca1d5e-6594-442f-82ca-8958316055fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096030 Sep 01 08:24:56.389930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1212/2397] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:56 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:56.560077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:56.560681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:56.566498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.566978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.567408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.568084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.568534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.569536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.639732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:56.648362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8aaa922f-44bb-4690-8b71-07db1281660a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.091903 Sep 01 08:24:56.648933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1186/2398] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:56 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:56.911523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:56.912045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:56.918654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.919132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.919563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.920241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:56.920686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:56.921105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:56.981783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:56.990268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20176032-4070-4dca-9fd5-fb220be2714e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082537 Sep 01 08:24:56.990931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1213/2399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:56 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:57.257268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:57.257968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:57.264000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.264482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.264924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.265608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.266058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.266515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.329888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:57.338044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c5e3c025-4855-4370-a69a-81d3339fa7a6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085227 Sep 01 08:24:57.338855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1187/2400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:57 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:57.339219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:57.339903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:57.345942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.346472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.346904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.347593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.348033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.348448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.411105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:57.414147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:57.414806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:57.420366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7fa88b94-a44f-4a6a-b059-e7dd297a0c57 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084903 Sep 01 08:24:57.420953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1214/2401] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:57 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:57.421119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.421466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.421994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.422718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.423163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.423578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.494083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:57.502285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:57.503736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:57.504810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91a6f8dc-86e5-4507-a653-45002cd43085 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096342 Sep 01 08:24:57.505354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1188/2402] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:57 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:24:57.669806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:57.670432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:57.676444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.676940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.677385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.678102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:57.678614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:57.679003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:57.741388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:57.749233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e71a49c0-0d90-4a93-8e82-4a741dbedac5 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083272 Sep 01 08:24:57.749796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1215/2403] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:57 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:58.011851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:58.012369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:58.018279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.018784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.019218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.019892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.020336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.020753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.082003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:58.091088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ea67bdb1-9896-4102-9667-888bd2131d57 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083169 Sep 01 08:24:58.091669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1189/2404] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:58 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:58.359074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:58.359678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:58.366173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.366682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.367137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.367822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.368268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.368812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.428887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:58.436594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c17435b3-674d-4e8f-b6b0-bea9d765f646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081276 Sep 01 08:24:58.437463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1216/2405] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:58 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:58.441226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:58.442512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:58.448923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.449486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.449982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.450776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.451227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.451640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.521114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:58.530434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-49872021-93d6-4504-be7e-d9ed8b50095a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093235 Sep 01 08:24:58.531007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1190/2406] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:58 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:24:58.533273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:58.534409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:58.543632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.544115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.544572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.545263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.545713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.546130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.607755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:58.615988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:58.617505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:58.618630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d9ac37f3-23d4-4e94-806b-d689f6103ea0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092746 Sep 01 08:24:58.619190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1217/2407] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:58 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:58.770556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:58.771194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:58.777774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.778266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.778718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.779392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:58.779839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:58.780261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:58.848997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:58.856685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0daa389-e7f2-4347-ae35-6bfa303cd454 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.089877 Sep 01 08:24:58.857248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1191/2408] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:58 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:59.112205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:59.112846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:59.119634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.120121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.120555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.121235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.121681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.122104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.183647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:59.191492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4fb77418-e064-4540-9471-848b91afb9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083058 Sep 01 08:24:59.192065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1218/2409] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:59 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:59.458405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:59.458954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:59.465653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.466133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.466663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.467426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.467791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.468208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.532057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:59.539805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ccff398-e2bb-4800-813e-3fe0e827582a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085418 Sep 01 08:24:59.540372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1192/2410] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:59 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:59.550960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:59.551561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:59.557494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.557969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.558429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.559104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.559546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.559962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.630202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:59.639272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-899b2f2b-14c0-4fa4-8309-8acd8b6687f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.091909 Sep 01 08:24:59.639861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1219/2411] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:59 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:24:59.641776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:59.642599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:59.652954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.653447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.653963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.654748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.655233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.655664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.717943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:59.726687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:59.728099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:59.729180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0613452f-df40-405c-a5ec-6fc360a2c3c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092113 Sep 01 08:24:59.729724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1193/2412] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:24:59 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:24:59.878439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:24:59.879039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:24:59.885528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.886000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.886470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.887145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:24:59.887583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:24:59.887998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:24:59.946917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:24:59.954368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1e84ba4c-ad8c-4087-9792-c8b4cd107b2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.079859 Sep 01 08:24:59.954918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1220/2413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:24:59 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:00.211637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:00.212296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:00.218189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.218702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.219141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.219847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.220291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.220711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.285284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:00.293503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-251832cd-ea1a-4377-b65f-b784dd707d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086197 Sep 01 08:25:00.294068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1194/2414] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:00 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:00.560270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:00.560972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:00.567366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.567945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.568477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.569287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.569904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.574784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.634770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:00.642699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7dc17ac7-260c-4ccb-92d0-36a2b93ab001 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086029 Sep 01 08:25:00.643330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1221/2415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:00 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:00.660663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:00.661363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:00.668258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.668731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.670735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.670735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.670735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.670735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.735088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:00.744494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0d6ece66-e892-4795-b776-43c92fa0afb7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087496 Sep 01 08:25:00.745384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1195/2416] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:00 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:00.752792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:00.753428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:00.760589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.761045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.761476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.762173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.762659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.763082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.827442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:00.836490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:00.837933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:00.839059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-343ca333-a106-44e8-baa3-4ea1f2b70651 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090584 Sep 01 08:25:00.839610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1222/2417] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:00 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:00.840193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2141995128", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "networks": [{"uuid": "aab87eba-4a49-4163-b9bf-842b83e94ed8"}]}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:25:00.893909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] validate_networks() for [('aab87eba-4a49-4163-b9bf-842b83e94ed8', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:25:00.976453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:00.977373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:00.984801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.985296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.985729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:00.986480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:00.986932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:00.987360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.071289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.079006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-710c9610-1629-4de4-ab8a-0b40462c7167 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.107481 Sep 01 08:25:01.079582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1223/2418] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:00 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:01.282410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:25:01.282818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:25:01.283281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:25:01.283686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:25:01.284082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:25:01.294527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.294999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.295424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.296128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.296569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.296989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.313215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Getting quotas for project 82d7e2503aa043929798769c22c1b2da. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:25:01.314484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:01.315196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:01.316988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Getting quotas for user d713712c30574895b82beedb9c4f251d and project 82d7e2503aa043929798769c22c1b2da. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:25:01.321229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.321790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.322227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.322933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.323380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.323796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.328470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:25:01.330627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:25:01.378761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1c638428-85d0-425c-b3e6-a226e57ecb12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542253 Sep 01 08:25:01.379592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1196/2419] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 08:25:01.386419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.389995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e6de66a8-a887-4105-8d67-9a96111cff06 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:01.390629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e6de66a8-a887-4105-8d67-9a96111cff06 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:01.395837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9755c1ab-e2f7-4060-8371-cbdb18eab5c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084997 Sep 01 08:25:01.398087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1224/2420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:01 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:01.445416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e6de66a8-a887-4105-8d67-9a96111cff06 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.453087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e6de66a8-a887-4105-8d67-9a96111cff06 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1219 microversion: 2.1 time: 0.066837 Sep 01 08:25:01.453664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1197/2421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:01 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:01.663873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:01.664500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:01.671604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.672346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.672948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.673917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.674660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.675133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.739330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.747902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-367c74b9-658f-4020-b565-70d3c26369c4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087888 Sep 01 08:25:01.748504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1225/2422] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:01 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:01.767171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:01.768056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:01.775497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.775989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.776548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.777260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.777781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.777927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.849234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.857615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5e18fea7-744c-4cf5-b861-1f9a575c22cc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.094586 Sep 01 08:25:01.858196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1198/2423] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:01 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:01.862062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:01.862698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:01.870558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.871078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.871500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.872226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:01.872711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:01.873453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:01.938150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.947534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.949058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:01.950143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-87b161f2-78cf-4e5a-b8f4-c80e7c628071 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092002 Sep 01 08:25:01.950723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1226/2424] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:01 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:02.101220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:02.101819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:02.107810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.108285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.108711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.109386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.109832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.110250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.170676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:02.178797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19706c11-3c5a-4c4d-9c16-0fdde015f974 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081110 Sep 01 08:25:02.179448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1199/2425] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:02 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:02.418538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:02.419135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:02.425007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.425478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.426016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.426668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.427107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.427517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.474626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:02.475942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:02.482602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.483084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.483525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.484214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.484664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.485084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.492971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:02.495233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:02.502418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d822d207-352a-4678-82e3-9672bf42454e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088326 Sep 01 08:25:02.502987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1227/2426] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:02 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:02.504394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:02.554289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:02.561889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-caf6c1f4-eeed-46d2-a231-9ccdff1bc986 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091249 Sep 01 08:25:02.562478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1200/2427] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:02 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:02.769012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:02.769572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:02.776310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.776790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.777215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.777898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.778371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.778789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.840842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:02.848292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-48fa63d4-4ca7-4e89-a60f-81a30aba9e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083162 Sep 01 08:25:02.848856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1228/2428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:02 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:02.878795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:02.879401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:02.886096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.886624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.887045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.887729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.888175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.888594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.950827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:02.959022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c74d4174-a914-498d-959d-37823b38a6f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083974 Sep 01 08:25:02.959648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1201/2429] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:02 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:02.973507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:02.974154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:02.981147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.981673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.982095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:02.985776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:02.985776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:02.985776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.046233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:03.054419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:03.056142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:03.057219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-814de5d1-d8cb-4048-8861-6fc861ab5715 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088384 Sep 01 08:25:03.057766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1229/2430] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:02 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:03.199923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:03.200524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:03.206473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.206945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.207633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.208303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.208743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.209755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.271168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:03.279940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8c5dc76c-f7ca-4f95-a8ff-a24972530146 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083779 Sep 01 08:25:03.280519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1202/2431] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:03 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:03.523801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:03.524410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:03.530558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.531040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.531494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.532182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.532635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.533058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.583451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:03.584440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:03.593134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.593850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.594472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.595298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.595821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.596413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.606573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:03.614419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dbcc5661-a517-4ad6-afe9-84f6644bae3a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094768 Sep 01 08:25:03.614996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1230/2432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:03 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:03.663526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:03.671443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7cd9a84e-621f-4995-ab35-aac4460ce160 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.092959 Sep 01 08:25:03.672004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1203/2433] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:03 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:03.869970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:03.870593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:03.877365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.877854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.878322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.879031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.879523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.879952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.942428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:03.950027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-abe041c7-f8e4-4fa7-878c-c4a82b36d266 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084513 Sep 01 08:25:03.950620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1231/2434] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:03 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:03.981819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:03.982466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:03.988334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.988809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.989237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:03.989915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:03.991051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:03.991662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.055181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:04.062999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f9773354-3824-4466-ada5-7ac183c0a9d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086373 Sep 01 08:25:04.063580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1204/2435] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:03 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:04.079901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:04.080565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:04.093156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.093645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.094078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.094815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.095268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.095686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.175180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:04.183299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:04.184732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:04.185822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8aac91af-f6e3-4fc5-af29-5d94b3a5b4b4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.109784 Sep 01 08:25:04.186395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1232/2436] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:04 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:04.300522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:04.301121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:04.308415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.308894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.309329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.310004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.310478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.310896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.371134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:04.378585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-37fa6fb5-c813-46ff-858f-f41f5412b42d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081787 Sep 01 08:25:04.379143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1205/2437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:04 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:04.637490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:04.638096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:04.643970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.644447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.644876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.645551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.645999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.646451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.692477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:04.693077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:04.699864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.700347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.700778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.701462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.701906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.702352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.708370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:04.716664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-48497093-52e8-4403-a83e-b7993a344925 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083023 Sep 01 08:25:04.717242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1233/2438] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:04 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:04.767086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:04.775508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-449009c5-feab-49e1-80c2-414228ba3a08 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086839 Sep 01 08:25:04.776080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1206/2439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:04 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:04.970828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:04.971444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:04.977724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.978208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.978686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:04.979359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:04.979826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:04.980243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.043094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:05.050528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-56fc39d2-b52e-4cdb-918c-0af80631b1b5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083595 Sep 01 08:25:05.051080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1234/2440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:04 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:05.083751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:05.084377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:05.090199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.090708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.091135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.091801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.092246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.092666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.154011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:05.162366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e389ba4-99a3-4619-a23d-1bbc4b4478d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082370 Sep 01 08:25:05.163024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1207/2441] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:05 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:05.209328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:05.209921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:05.216066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.216545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.216971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.217661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.218120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.218567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.280304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:05.288933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:05.290372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:05.291505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a05ad5d-04bd-44e2-930c-f616c621bb04 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086324 Sep 01 08:25:05.292017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1235/2442] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:05 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:05.399485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:05.400089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:05.406068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.406582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.407014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.407686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.408132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.408553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.472982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:05.481524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dafee70f-2092-46c1-8d63-e607782b5adc tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086089 Sep 01 08:25:05.483417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1208/2443] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:05 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:05.737446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:05.737961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:05.744187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.744666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.745098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.745807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.746271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.746701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.796450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:05.797058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:05.803127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.803804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.804246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.804960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:05.805410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:05.805838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:05.965985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:05.973761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1da28adb-6b5c-4091-8580-f545c55b3bcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.240161 Sep 01 08:25:05.974431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1236/2444] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:05 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:05.992197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:06.000829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f016b196-2558-4e0c-b290-8eed5f54f634 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.208388 Sep 01 08:25:06.001395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1209/2445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:05 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:06.071677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:06.072281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:06.078229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.078741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.079201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.079864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.081553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.081553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.150940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:06.158388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-422e8f87-7aca-4302-a75f-c0384b686b3a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091263 Sep 01 08:25:06.158941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1237/2446] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:06 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:06.186835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:06.187441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:06.193875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.194415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.194892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.195570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.196016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.196432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.257286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:06.265074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-020c3985-c1a2-43f9-89ec-97fa6c154643 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081957 Sep 01 08:25:06.265632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1210/2447] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:06 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:06.313575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:06.314179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:06.321127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.321586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.322022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.322748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.323194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.323617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.389283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:06.397517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:06.399085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:06.400055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c69f2bc5-89c3-4d66-8179-4e0672b2cb10 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090379 Sep 01 08:25:06.400600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1238/2448] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:06 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:06.514250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:06.514819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:06.522733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.523433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.523955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.524710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:06.525185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:06.525608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:06.587293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:06.594763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2dbd9a93-4c5f-41cc-960f-6cd1ff4c6deb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084417 Sep 01 08:25:06.595317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1211/2449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:06 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:06.994961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:06.995594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:07.001531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.002005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.002458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.003137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.003584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.004001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.022894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:07.023497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:07.029219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.029689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.030115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.030821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.031262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.031675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.065380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.074002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ada8da4b-daa5-4e0b-91d6-86a4f13ee552 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082865 Sep 01 08:25:07.074873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1239/2450] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:06 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:07.094390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.102623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09bcccf1-c58e-412e-a4f7-fc1af80d4274 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084399 Sep 01 08:25:07.103182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1212/2451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:07 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:07.179324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:07.179927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:07.186012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.186523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.186954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.187637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.188077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.188488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.253383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.261662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8cc7b575-d6db-4c21-94a1-9391ba97ca18 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086786 Sep 01 08:25:07.262222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1240/2452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:07 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:07.286234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:07.286895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:07.292752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.293218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.293641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.294329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.294773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.295184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.355378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.363093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d17109a3-80da-4685-b3b1-e19b7f73009d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080593 Sep 01 08:25:07.363658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1213/2453] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:07 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:07.422405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:07.423001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:07.429529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.430013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.430476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.431165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.431613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.432033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.496297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.504417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.505791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.507251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8548b652-5979-463a-89e7-87591d0a25e9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088766 Sep 01 08:25:07.507807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1241/2454] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:07 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:07.616335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:07.616932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:07.622862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.623334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.623761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.624428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:07.624872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:07.625285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:07.685292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:07.693008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5cbd1405-adf4-4efb-b0f3-b8b5b4627203 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081086 Sep 01 08:25:07.693616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1214/2455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:07 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:08.095445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:08.096047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:08.102705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.103176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.103603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.104285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.104724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.105154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.124723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:08.125340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:08.131506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.132139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.132580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.133442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.134164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.134617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.174093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.182497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5822945f-e266-42f5-9045-cf84edad6c85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090922 Sep 01 08:25:08.183074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1242/2456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:08 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:08.202116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.210800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0233917a-69de-4745-91a6-e3c71159cd4e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090180 Sep 01 08:25:08.211359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1215/2457] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:08 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:08.281518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:08.282121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:08.284017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:08.289524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.290003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.290470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.291166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.291612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.292030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.354720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.362405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-87070b9c-dbb7-4bb8-9cd2-9f990ec51dd9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084678 Sep 01 08:25:08.362948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1243/2458] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:08 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:08.384571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:08.385176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:08.387009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:08.392509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.392988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.393420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.394108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.394590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.395019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.456451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.464842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aa1b74a6-299f-432b-bd36-cea5c485383c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084650 Sep 01 08:25:08.465401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1216/2459] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:08 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:08.532928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:08.534005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:08.544880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.545727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.546518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.547763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.548516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.549266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.572017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:08.621235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.629287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.631540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.632489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-effbfb93-7a14-4b80-9a40-2509b11af347 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.106663 Sep 01 08:25:08.633042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1244/2460] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:08 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:08.713488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:08.714088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:08.719970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.720442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.720925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.721595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:08.722040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:08.722484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:08.725006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:08.785387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:08.792981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6fb9fe08-a9de-44aa-bb51-88d4d798116c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083588 Sep 01 08:25:08.793538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1217/2461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:08 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:09.203224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:09.203899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:09.209960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.210459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.210892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.211560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.211999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.212409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.231574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:09.232179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:09.237980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.238496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.238929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.239613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.240083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.240502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.271818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.279311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f777693c-36d3-4b27-8f48-761d9e42a3c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.079826 Sep 01 08:25:09.279876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1245/2462] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:09 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:09.300625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.309032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b66e8a5-fd21-4546-8dab-683d07c28a99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081397 Sep 01 08:25:09.309594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1218/2463] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:09 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:09.383016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:09.383631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:09.389779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.390276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.390722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.391414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.391955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.392275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.453296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.462229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6c9ea90-3d98-4d38-a2f7-187e92b58f8d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083259 Sep 01 08:25:09.462809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1246/2464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:09 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:09.484787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:09.485397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:09.491787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.492263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.492697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.493368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.493813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.494231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.557450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.564895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-697e1b81-8817-47ff-8f01-12923cf1d3ec tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083951 Sep 01 08:25:09.565449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1219/2465] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:09 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:09.654916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:09.655663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:09.663607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.664100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.664532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.665229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.665677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.666095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.729222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.737446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.738906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.740012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-adb830f9-4c47-4ed8-b30c-e1c363ad91e7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089834 Sep 01 08:25:09.740549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1247/2466] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:09 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:09.812872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:09.813500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:09.819875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.820366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.820779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.821443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:09.821886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:09.822326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:09.884313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:09.891890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-88b1089a-1559-4b8a-a54c-281a9b68a25b tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082845 Sep 01 08:25:09.892470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1220/2467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:09 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:10.300193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:10.300799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:10.306737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.307213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.307645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.308322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.308768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.309186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.328751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:10.329505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:10.336441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.336920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.337345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.338021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.338491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.338905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.387758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.395305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13d37d96-bdbf-4bc1-86fc-9f18aa0fd761 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.098975 Sep 01 08:25:10.395873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1248/2468] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:10 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:10.410500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.419511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f2c4bd85-2706-49ea-ac3e-8792ae329e7f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094331 Sep 01 08:25:10.420181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1221/2469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:10 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:10.485036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:10.485637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:10.492158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.492641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.493077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.493765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.494213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.494658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.555923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.563383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-01c33f39-393c-4694-b261-6e1d1eb67a2b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082234 Sep 01 08:25:10.563949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1249/2470] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:10 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:10.585877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:10.586626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:10.592528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.593010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.593453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.594140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.594618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.595042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.654658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.662201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15560e79-bca8-485b-b7ce-50b36b1ff61d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081135 Sep 01 08:25:10.663058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1222/2471] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:10 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:10.762884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:10.763512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:10.769714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.770190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.770643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.771358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.772359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.772778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.836605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.844975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.846445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.847541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e89f7f06-7889-4eec-af35-b7d3b5641d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088500 Sep 01 08:25:10.848103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1250/2472] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:10 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:10.913579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:10.914185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:10.920109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.920586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.921018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.921724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:10.922174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:10.922619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:10.984522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:10.992686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-88ac152a-be40-4c4c-b5bf-5c196750f8a1 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083138 Sep 01 08:25:10.993241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1223/2473] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:10 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:11.416194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:11.416774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:11.422711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.423182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.423609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.424274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.424714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.425126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.439305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:11.439906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:11.441807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:11.447932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.448414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.448975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.449796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.450406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.450817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.451252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=8 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:11.492881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:11.500729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9620f789-64d0-4998-90fb-520a74f15286 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088776 Sep 01 08:25:11.501545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1251/2474] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:11 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:11.518828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:11.526634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6395c3cc-68b7-4f36-8238-377428bde838 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091101 Sep 01 08:25:11.527208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1224/2475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:11 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:11.584917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:11.585519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:11.591581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.592060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.592484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.593171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.593611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.594022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.657836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:11.666152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a4b110b4-52ea-45ee-92ee-93a142e669b1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085314 Sep 01 08:25:11.666801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1252/2476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:11 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:11.682432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:11.683048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:11.688900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.689374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.689804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.690512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.690956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.691376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.752298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:11.760646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5117b5ef-6901-4e90-a880-ac3d7092a111 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082027 Sep 01 08:25:11.761215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1225/2477] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:11 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:11.870001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:11.870661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:11.877656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.878136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.878614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.879305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:11.879745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:11.880161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:11.946005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:11.954744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:11.956180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:11.957552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3032c6ca-d45f-4bfc-ab7e-9089467210aa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091163 Sep 01 08:25:11.958111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1253/2478] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:11 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:12.013256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:12.013856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:12.019948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.020430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.020865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.021579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.022156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.022562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.084939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:12.092471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dff90ae2-f1f4-4640-9f43-89951c56a527 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083145 Sep 01 08:25:12.093198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1226/2479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:12 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:12.521512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:12.522110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:12.528113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.528586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.529009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.529689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.530130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.530578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.548115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:12.548813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:12.555461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.555942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.556375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.557055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.557505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.557922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.592247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:12.599978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17f6d435-c665-4d69-bdce-bb1796539755 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082200 Sep 01 08:25:12.600891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1254/2480] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:12 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:12.620440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:12.628080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-77e4282d-7063-41c8-b93d-1d40dd6b7fc5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083673 Sep 01 08:25:12.628575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1227/2481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:12 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:12.687043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:12.687645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:12.694449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.694953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.695383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.696137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.696587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.697003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.761850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:12.769557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-51240304-0516-4b53-8150-2e5cf9a16671 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086310 Sep 01 08:25:12.770170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1255/2482] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:12 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:12.782343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:12.782956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:12.789501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.789991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.790462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.791141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.791587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.792118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.851702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:12.859166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b62c1281-e191-484e-bdfe-b37ab8eeab5b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080774 Sep 01 08:25:12.859725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1228/2483] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:12 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:12.980666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:12.981181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:12.987372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.987846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.988275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:12.988961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:12.989402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:12.989815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.054582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.063097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.064517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.065747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf5997fe-6e12-4eb6-94f9-69af78811227 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089097 Sep 01 08:25:13.066321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1256/2484] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:12 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:13.113508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:13.114100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:13.120934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.121412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.121835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.122537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.122981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.123399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.183199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.190855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7fd6e367-e198-43c2-9e56-566cbd79e9ca tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081122 Sep 01 08:25:13.191410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1229/2485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:13 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:13.620163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:13.620768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:13.626673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.627146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.627570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.628237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.628679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.629095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.650003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:13.650628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:13.656468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.656941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.657366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.658070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.658542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.658954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.694574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.702338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1f57ec10-7118-4f2c-9294-20298976842d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085904 Sep 01 08:25:13.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1257/2486] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:13 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:13.721014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.728521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26a39c21-22f4-477b-9892-7eb3c54810bb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083027 Sep 01 08:25:13.729052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1230/2487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:13 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:13.790131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:13.790870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:13.796735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.797213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.797638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.798340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.798786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.799200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.861071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.869753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-89f1ee6c-0a73-402a-872f-1ca212d6951a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083500 Sep 01 08:25:13.870333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1258/2488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:13 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:13.881566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:13.882347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:13.888181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.888660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.889088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.889768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:13.890210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:13.890648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:13.958007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:13.966201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-23841477-e99d-46cf-8fba-12d2621a6b04 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088994 Sep 01 08:25:13.966800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1231/2489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:13 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:14.091484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:14.092097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:14.098187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.098710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.099146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.100504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.101074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.101537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.168945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:14.177413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:14.178880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:14.179976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8fadd9b3-7e81-4238-8627-d83d4dc7cdcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093924 Sep 01 08:25:14.180528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1259/2490] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:14 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:14.212302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:14.212910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:14.219039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.219521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.219959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.220699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.221372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.221989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.283877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:14.291570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-41545576-3d55-4238-9868-2c58a98352a3 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083760 Sep 01 08:25:14.292126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1232/2491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:14 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:14.723762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:14.724308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:14.730781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.731251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.731677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.732348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.732788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.733199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.748385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:14.749044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:14.754879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.755358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.756444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.757134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.757585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.758007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.794815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:14.803229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9ed07fda-7de4-4853-9a2e-bde8444204ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082698 Sep 01 08:25:14.803793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1260/2492] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:14 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:14.821165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:14.823320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:14.829839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-553d454e-8d00-4728-a3a3-3d3809b4c6ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085286 Sep 01 08:25:14.830420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1233/2493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:14 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:14.891754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:14.892358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:14.898934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.899411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.899841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.900525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.900974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.901393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:14.904125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:14.963154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:14.971388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-adb32faa-f427-43bd-9d2d-5d80ad41980f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083423 Sep 01 08:25:14.971941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1261/2494] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:14 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:14.992142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:14.992921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:14.998887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:14.999368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:14.999798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.000474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.000918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.001337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.065026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:15.073414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fe46c4f7-de7b-4c74-a730-a3ee724f2d68 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086040 Sep 01 08:25:15.073959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1234/2495] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:14 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:15.202596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:15.203114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:15.212225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.212711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.213144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.213848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.214354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.214776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.278010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:15.286547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:15.288581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:15.289702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5aae90af-effe-4763-be6e-b63db6ff540e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091110 Sep 01 08:25:15.290281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1262/2496] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:15 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:15.312125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:15.312754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:15.319432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.319911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.320346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.321028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.321479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.321896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.382530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:15.390025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-775040b1-dbe6-4891-a31b-41422447e968 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081882 Sep 01 08:25:15.390610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1235/2497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:15 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:15.823867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:15.824469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:15.830325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.830798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.831221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.831915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.832619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.833031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.851129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:15.851735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:15.857544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.858054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.858518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.859197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.859643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:15.860067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:15.893345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:15.901724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a86feb24-ed92-45a5-8d47-21fae4e7d8f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081626 Sep 01 08:25:15.902328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1263/2498] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:15 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:15.924341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:15.932633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-db9f3428-0617-448f-945d-61c12b32724f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086124 Sep 01 08:25:15.933194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1236/2499] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:15 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:15.992390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:15.993086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:15.999207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:15.999685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.000118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.000811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.001258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.001676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.062671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:16.070830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-64456bcf-dff6-4b93-b93c-a91dba62f2f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082955 Sep 01 08:25:16.071383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1264/2500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:15 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:16.095046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:16.095582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:16.102627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.103108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.103594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.104276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.104724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.105142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.166579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:16.174028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e85a9070-b0da-4abf-b725-db52e9e0a163 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083155 Sep 01 08:25:16.174620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1237/2501] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:16 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:16.312427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:16.313026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:16.319240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.319719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.320147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.320829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.321275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.321697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.387619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:16.403218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:16.404856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:16.405992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9d1fabf1-03c4-43a6-ad6c-2540c92eafee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.097474 Sep 01 08:25:16.406571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1265/2502] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:16 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:16.410123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:16.410775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:16.417601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.418090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.418550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.419238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.419685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.420102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.483882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:16.491509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f3b0aa1-25aa-4f7f-b075-173d55cfeb58 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085351 Sep 01 08:25:16.492062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1238/2503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:16 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:16.922727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:16.923387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:16.929970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.930477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.930911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.931593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.932032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.932448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.956253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:16.957576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:16.967241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.968042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.968740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:16.969841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:16.970806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:16.971498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.003105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.011396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1d7128b-47ee-45ca-8892-3e6172e2bee6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.092384 Sep 01 08:25:17.012241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1266/2504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:16 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:17.032296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.040134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb37aae7-e22b-4f6f-bb96-9de7ff86c26f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090544 Sep 01 08:25:17.040692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1239/2505] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:16 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:17.093160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:17.093697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:17.100092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.100657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.101098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.101794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.102283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.102706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.165594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.173332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-96a16493-9dd2-4bd5-b2ba-8f6ed51ed9f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083980 Sep 01 08:25:17.173833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1267/2506] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:17 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:17.194165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:17.194793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:17.200683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.201151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.201595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.202244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.202710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.203120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.265648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.273998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-acb6c56a-1355-42cf-9e03-766c08f570f4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083614 Sep 01 08:25:17.274586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1240/2507] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:17 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:17.429230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:17.429737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:17.435791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.436264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.436717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.437410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.437855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.438293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.502400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.514378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.515732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:17.516797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:17.516925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.518672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40b968f6-6e94-4496-ae27-2268c02c7bf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093436 Sep 01 08:25:17.519576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1268/2508] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:17 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:17.526191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.526191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.526191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.526918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:17.527369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:17.527790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:17.589853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:17.597372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-449cef30-d9a0-4f9c-9ab7-898abcf42acd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.088369 Sep 01 08:25:17.597925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1241/2509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:17 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:18.031126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:18.031807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:18.038468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.038949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.039379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.040118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.040574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.040995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.060971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:18.061612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:18.067546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.068027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.069145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.069983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.070468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.070892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.104122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.111869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09bfa905-8b70-4626-93ba-0155f4427172 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084609 Sep 01 08:25:18.112435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1269/2510] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:18 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:18.135426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.142978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d32f7871-e90b-49c4-ab15-fdd856c57d90 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085800 Sep 01 08:25:18.143529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1242/2511] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:18 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:18.194679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:18.195280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:18.201309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.201785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.202217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.202941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.203391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.203811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.265088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.273236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9621621a-e501-4c43-bbf4-b5585f687809 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082898 Sep 01 08:25:18.273789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1270/2512] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:18 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:18.294103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:18.294671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:18.300517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.300990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.301421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.302095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.302573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.303259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.363162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.371186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ea27756-80d8-4436-a9ee-642c05887380 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080893 Sep 01 08:25:18.371742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1243/2513] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:18 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:18.542640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:18.543267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:18.549432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.549809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.550232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.550969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.551411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.551825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.614762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.619282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:18.619885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:18.623576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.624992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.625738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.626104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f8999e8a-4de7-46d1-b211-154a42f60488 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087735 Sep 01 08:25:18.626220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.626686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.626841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1271/2514] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:18 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:18.627387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:18.627834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:18.628252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:18.692924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:18.700439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0cb71023-4932-4ae1-8e0a-4b947c5cc9c2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085809 Sep 01 08:25:18.700987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1244/2515] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:18 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:19.132465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:19.133088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:19.139014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.139494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.139920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.140598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.141043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.141462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.166763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:19.167366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:19.173353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.173826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.174284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.174968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.175416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.175837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.206496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.215058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b89ba33-6f45-4dd6-a151-5751cedbc28c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086423 Sep 01 08:25:19.215660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1272/2516] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:19 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:19.236961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.244733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a0551ef-a595-4f76-8998-1f41719e43c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081757 Sep 01 08:25:19.245291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1245/2517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:19 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:19.293828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:19.294451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:19.300391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.300864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.301287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.301966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.302437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.303103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.363748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.371447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c1dbeb3-46a4-4c79-b684-613890080fbb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081465 Sep 01 08:25:19.372020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1273/2518] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:19 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:19.391997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:19.392535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:19.399242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.399725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.400156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.400835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.401303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.401749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.464139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.472110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4240a351-c592-442f-877f-a26fb145020c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083621 Sep 01 08:25:19.472374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1246/2519] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:19 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:19.650667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:19.651189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:19.657392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.658545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.658545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.659209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.659736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.660436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.722576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.722756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:19.723320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:19.730564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.731355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.731486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.731854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.732157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:19.732703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:19.733116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:19.733569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.734784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6ba49ee7-b217-4257-8c8a-c1b3c778135f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088973 Sep 01 08:25:19.735433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1274/2520] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:19 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:19.801056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:19.809305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f89570b4-1e8b-40d3-ba53-9b2a285f0d22 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090424 Sep 01 08:25:19.809883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1247/2521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:19 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:20.236601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:20.237189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:20.243854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.244423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.244855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.245548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.245985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.246433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.265198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:20.265926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:20.271723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.272194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.272621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.273298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.273739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.274155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.318649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.326814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b81620de-de4a-4965-9363-cd591668fe7d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094228 Sep 01 08:25:20.327376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1275/2522] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:20 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:20.347612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.356523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a1dbb76a-2953-43e9-b6a4-8478af23204f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094944 Sep 01 08:25:20.357087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1248/2523] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:20 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:20.392040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:20.392629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:20.399533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.400014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.400441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.401132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.401593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.401991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.464527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.472204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9f84a9a-9287-4324-a180-1718c449039f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083913 Sep 01 08:25:20.472677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1276/2524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:20 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:20.493438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:20.493975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:20.499944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.500421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.500852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.501530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.501978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.502432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.564988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.573236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-59c6712b-760a-443f-82f5-cd4eb9283bfa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084122 Sep 01 08:25:20.574770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1249/2525] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:20 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:20.757222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:20.757776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:20.763651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.764150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.764573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.765240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.765682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.766093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.826925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.829252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:20.830897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:20.831678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:20.837710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.837969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.838470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.838936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.839166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.839638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:20.840091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:20.840265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ff42512-7c5e-4160-b806-a549edf54aa3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087111 Sep 01 08:25:20.840522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:20.841037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1277/2526] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:20 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:20.858461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:20.915067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:20.922905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a82ebb9e-0565-4708-ad07-dc68e93bffec tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.095800 Sep 01 08:25:20.923478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1250/2527] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:20 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:21.347508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:21.348102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:21.354554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.355026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.355450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.356120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.356560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.356973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.376846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:21.377481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:21.383535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.384015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.384449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.385137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.385585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.386007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.416339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:21.423993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce127d57-dac3-4e9b-9e88-0fbe5cd48d23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080274 Sep 01 08:25:21.424558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1278/2528] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:21 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:21.447342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:21.454925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ab60e017-16e9-4d49-ba75-59132f1ed7db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081932 Sep 01 08:25:21.455475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1251/2529] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:21 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:21.493522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:21.494127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:21.500225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.500709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.501145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.501834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.502310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.502736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.567081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:21.575567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e077e58-85bc-4655-b896-43694c4b2d7d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086371 Sep 01 08:25:21.576130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1279/2530] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:21 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:21.595770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:21.596378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:21.602626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.603049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.603483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.604167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.604644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.605071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.666781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:21.674274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2828290-037a-4f7b-bc2d-7cf3128541db tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082282 Sep 01 08:25:21.674844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1252/2531] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:21 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:21.862835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:21.863375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:21.870368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.870844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.871269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.871945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.872387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.872800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.942285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:21.944320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:21.944925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:21.950695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:21.951048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.951533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.951967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.952135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:21.952656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:21.953106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:21.953228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d0d98850-e7c9-4fa0-8e68-322e361d841e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094361 Sep 01 08:25:21.953584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:21.954293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1280/2532] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:21 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:22.017122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:22.025803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c0a1397f-5ff7-4c08-8f47-b5e1e38c4909 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085120 Sep 01 08:25:22.026482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1253/2533] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:21 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:22.446068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:22.446713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:22.452530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.453002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.453426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.454124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.454589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.455003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.476294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:22.476923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:22.482918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.483395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.483829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.484503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.484950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.487282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.516667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:22.524489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5bae24a-fa21-4e0f-b5e3-e783663f828f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082992 Sep 01 08:25:22.525062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1281/2534] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:22 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:22.550910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:22.559254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1425a221-bc13-457d-870b-018664ab5d8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087271 Sep 01 08:25:22.559827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1254/2535] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:22 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:22.596598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:22.597176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:22.603986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.604469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.604909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.605602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.606057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.606513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.668878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:22.676422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e93d5029-7057-4f75-ba6b-41b666d78b44 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083883 Sep 01 08:25:22.676969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1282/2536] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:22 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:22.695418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:22.696030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:22.701856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.702370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.702802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.703478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.703925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.704346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.764042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:22.771680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a5cf2086-4707-40aa-b411-fae3b9cb8f4d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080225 Sep 01 08:25:22.772239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1255/2537] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:22 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:22.976618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:22.977265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:22.983190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.983666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.984096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:22.984780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:22.985227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:22.985650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.047068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:23.047447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.047593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:23.054032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.054691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.055130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.055831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.056129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.056287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.056703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.057544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.058666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-073efe48-7997-4b0f-b8f5-9ab28e58d200 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086602 Sep 01 08:25:23.059359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1283/2538] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:22 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:23.125754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.133755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c3b5eff7-7726-4a0b-90c2-6ec390491eda tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090561 Sep 01 08:25:23.134362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1256/2539] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:23 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:23.544600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:23.545220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:23.551353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.551830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.552257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.552936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.553379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.553795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.580184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:23.580873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:23.587853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.588341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.588772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.589461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.589910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.590357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.614035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.621869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a6e3bc52-29cd-4a06-ad97-48c68ee436f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081134 Sep 01 08:25:23.622468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1284/2540] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:23 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:23.650507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.658107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf720b0a-fcfd-4bb9-a170-e999d599907d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081776 Sep 01 08:25:23.658729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1257/2541] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:23 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:23.697410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:23.698017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:23.704090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.704564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.704995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.705679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.706128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.706585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.768091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.776298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-36e565ee-53b3-4045-a8f6-daccf8f3e9a8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083186 Sep 01 08:25:23.776862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1285/2542] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:23 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:23.792713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:23.793317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:23.799278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.799750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.800180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.800853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:23.801302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:23.801724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:23.869212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:23.879329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6df3524f-e6cb-488e-80b3-bf339b2077ea tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090552 Sep 01 08:25:23.879895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1258/2543] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:23 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:24.085606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:24.086206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:24.092827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.093307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.093738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.094470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.094922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.095345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.155617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:24.156230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:24.162631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.163125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.163564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.164101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.164257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.164712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.165201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.173942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.175428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.176536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-592fab21-4819-444a-bb9f-ca639b60fea6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095258 Sep 01 08:25:24.177328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1286/2544] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:24 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:24.244102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.254369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-133217af-2c28-491f-bc38-c4de8e1fb2f9 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.102470 Sep 01 08:25:24.255329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1259/2545] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:24 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:24.643321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:24.643895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:24.649803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.650276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.650731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.651399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.651845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.652258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.678371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:24.679822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:24.685959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.686471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.686899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.687581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.688032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.688602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.713593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.721357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-29b44289-a302-4ad6-8af1-1da99bbe72a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082009 Sep 01 08:25:24.721923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1287/2546] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:24 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:24.752302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.760427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b8bebb0c-242d-42d7-8556-e23970b66961 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085817 Sep 01 08:25:24.760986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1260/2547] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:24 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:24.796849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:24.797447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:24.803475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.804723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.805155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.805842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.806307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.806724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.877000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.885347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2d7aaa5-82dc-460a-8ec1-22f5f1d68177 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.092302 Sep 01 08:25:24.885905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1288/2548] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:24 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:24.901955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:24.902636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:24.908644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.909121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.909550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.910221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:24.910691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:24.911105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:24.971122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:24.978848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b95f81cf-d560-4c74-ba04-2673a6c5cd0a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080803 Sep 01 08:25:24.979399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1261/2549] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:24 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:25.210859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:25.211414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:25.217322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.217794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.218217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.218908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.219349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.219761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.278094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:25.278671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:25.281520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:25.285569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.286315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.286744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.287637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.288628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.289052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.290460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:25.291908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:25.293019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d8e671b4-dd93-4a54-b646-59e52cc01e98 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086382 Sep 01 08:25:25.293582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1289/2550] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:25 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:25.354472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:25.362163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e6b5768a-4091-4754-87a8-e538fdde22cd tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.089007 Sep 01 08:25:25.362765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1262/2551] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:25 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:25.742803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:25.743356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:25.749372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.749856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.750309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.751033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.751515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.751935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.780970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:25.781893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:25.787866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.789077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.789547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.790301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.790744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.791161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.813620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:25.821701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f269ef4b-b61d-4395-b091-5f5baad12922 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083785 Sep 01 08:25:25.822630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1290/2552] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:25 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:25.854109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:25.861738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1178edc7-7a60-4f73-b270-29ab424abe65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084649 Sep 01 08:25:25.862460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1263/2553] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:25 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:25.907354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:25.907953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:25.914111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.914621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.915056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.915752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:25.916204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:25.916623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:25.978450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:25.985918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1dca7cf-f55a-47d4-a99b-50c4f52ac5a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082446 Sep 01 08:25:25.986501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1291/2554] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:25 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:26.000128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:26.000691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:26.007337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.007864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.008383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.009060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.009502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.009915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.072812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:26.080292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3f94299f-401e-4070-9957-fc484c03145a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083989 Sep 01 08:25:26.081105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1264/2555] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:25 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:26.315972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:26.316610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:26.323182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.323662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.324093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.324783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.325218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.325637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.385161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:26.385752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:26.386460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:26.391779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.392259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.392694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.393379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.393995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.394453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.394566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:26.395959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:26.397042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3852c6e3-4223-46b3-8402-97f5b56b46dc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084965 Sep 01 08:25:26.397593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1292/2556] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:26 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:26.456992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:26.466738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-74eb2b6d-1262-40dc-8459-b6b1855e0e3a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.086993 Sep 01 08:25:26.467322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1265/2557] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:26 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:26.844072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:26.844690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:26.846552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:26.852073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.852551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.852989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.853672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.854123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.854577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.883149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:26.883786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:26.885618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:26.891345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.891832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.892264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.892953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:26.893406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:26.893828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:26.915550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:26.923503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-04fad8e5-8f5c-4b4d-9a90-4e8b4894625d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083250 Sep 01 08:25:26.924210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1293/2558] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:26 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:26.959429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:26.967919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-98e3ec61-991b-43bf-a155-1bc9b604df1e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089412 Sep 01 08:25:26.968476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1266/2559] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:26 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:27.006155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:27.006901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:27.013570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.014053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.014518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.015207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.015654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.016070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.031116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:27.077619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:27.085385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc13b281-1cb5-4398-8ca7-614107d24d4e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083065 Sep 01 08:25:27.085955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1294/2560] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:27 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:27.100746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:27.101400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:27.107414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.107884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.108314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.108980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.109426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.109839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.112360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:27.171128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:27.178594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fa1a3b0d-e5e7-4a17-a004-0f17d5dc301d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081682 Sep 01 08:25:27.179366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1267/2561] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:27 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:27.420473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:27.421002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:27.426942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.427455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.427854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.428536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.429170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.429598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.487853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:27.488483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:27.490645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:27.495141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.495630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.496055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.496744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.497205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.497610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.499351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:27.500766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:27.501846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7499adfe-9188-49d8-ac7e-8066ffb5e6f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085336 Sep 01 08:25:27.502470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1295/2562] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:27 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:27.560731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:27.568311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1c20e270-5ae4-48de-8202-0fe675def701 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.084244 Sep 01 08:25:27.568869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1268/2563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:27 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:27.944235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:27.945512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:27.951351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.951831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.952258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.952926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.953370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.953789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.988255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:27.988857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:27.995607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.996089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.996518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:27.997213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:27.997661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:27.998448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.158992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.168197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-af9ef196-c1d9-476d-9b13-7a796bc43de7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.227704 Sep 01 08:25:28.168771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1296/2564] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:27 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:28.173312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:28.173907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:28.180605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.181080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.181612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.182180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.182779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.183199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.186771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.194408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b406ba66-7391-4c2a-a70f-8f07c38ef389 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.209679 Sep 01 08:25:28.194907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1269/2565] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:27 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:28.199544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:28.200141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:28.205925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.206445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.206879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.207827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.208302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.208720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.252380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.260120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8025a698-3a64-416e-9489-69a420f8f762 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090373 Sep 01 08:25:28.260769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1297/2566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:28 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:28.271274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.279068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6300fb5c-9bf4-4638-b2fd-060b89257be3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083064 Sep 01 08:25:28.279623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1270/2567] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:28 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:28.525763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:28.526394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:28.532277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.532755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.533185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.533862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.534332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.534754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.589396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:28.590123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:28.596140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.596702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.597138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.597818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:28.598316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:28.598702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:28.598947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.607306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.608754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.609880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-14294967-c2c6-4bc8-a98e-2a92bbb5ef5d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088755 Sep 01 08:25:28.610470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1298/2568] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:28 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:28.659651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:28.668162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7aa4fa82-5fdf-4b4e-baef-b2cc42e477cb tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082511 Sep 01 08:25:28.668731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1271/2569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:28 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:29.191834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:29.192447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:29.199047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.199525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.199954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.200641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.201088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.201504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.215765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:29.216351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:29.222312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.222801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.223239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.223928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.224380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.224803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.272723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.280499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e8eb5252-4174-472c-a921-5447dbf45a35 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.092674 Sep 01 08:25:29.281067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1299/2570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:29 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:29.285406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:29.285997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:29.292710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.293194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.293337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.293626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.294332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.294781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.295315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.304555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9fb7139d-1509-487f-8dd3-38e6e417177e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091265 Sep 01 08:25:29.304555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1272/2571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:29 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:29.309021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:29.309614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:29.315499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.315974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.316401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.317083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.317531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.317942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.361654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.370152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-92ec8044-bd09-4853-a53c-2e1044fd3eef tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088059 Sep 01 08:25:29.370742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1300/2572] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:29 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:29.388625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.396326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e98797ca-cff3-4a3b-ba0b-6e9813721e84 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090998 Sep 01 08:25:29.396887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1273/2573] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:29 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:29.633323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:29.633918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:29.639776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.640245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.640668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.641363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.641805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.642215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.688183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:29.688916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:29.695406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.695879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.696298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.696968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:29.697407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:29.697818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:29.704166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.712913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.714356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.715437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38db9017-94e1-4a37-b30e-8e44bfefafd3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086663 Sep 01 08:25:29.715983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1301/2574] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:29 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:29.759117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:29.766731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48c657ea-2e0a-4c95-9fdf-92eb66fc7442 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082309 Sep 01 08:25:29.767294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1274/2575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:29 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:30.305075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:30.305672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:30.312385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.312859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.313294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.313985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.314459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.314878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.325331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:30.326040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:30.333862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.334393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.334838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.336013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.336483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.336952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.390715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.399049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21fc81e4-a8c1-47d9-8a81-46f8b65af340 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.097872 Sep 01 08:25:30.399616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1302/2576] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:30 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:30.404192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:30.404791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:30.411005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.411311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.411961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.412668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.413194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.413618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.415218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.422969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec6d8de9-ea31-46c6-bd5e-c10f13660ba1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.101416 Sep 01 08:25:30.423544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1275/2577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:30 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:30.429322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:30.429322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:30.435640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.436126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.436585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.437279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.437732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.438155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.491439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.499123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-57eb0b6b-a6a2-484b-af9c-3821315b57f6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.098536 Sep 01 08:25:30.499728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1303/2578] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:30 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:30.511041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.518610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e7117fd1-7060-40d6-bc62-b4e1ef10afe8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.094104 Sep 01 08:25:30.519155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1276/2579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:30 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:30.737581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:30.738091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:30.744548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.745023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.745448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.746120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.746591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.747006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.787542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:30.788152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:30.794081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.794588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.795015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.795693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:30.796137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:30.796547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:30.807882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.816022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.817449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.818563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b2fb2192-d119-431b-8286-999d5e8a47c0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084932 Sep 01 08:25:30.819119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1304/2580] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:30 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:30.859394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:30.867711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93e15c8c-08dc-4677-8f53-c3354d34ea0c tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083842 Sep 01 08:25:30.868274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1277/2581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:30 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:31.420252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:31.420855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:31.426811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.427285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.427719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.428408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.429488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.429921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.442970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:31.443580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:31.449854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.450385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.450823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.451521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.451973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.452396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.492444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.500143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-29e65cb9-494b-44d1-a110-30178efb16b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083731 Sep 01 08:25:31.500707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1305/2582] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:31 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:31.519589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:31.520197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:31.526817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.527301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.527743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.528438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.528890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.529317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.534314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.543254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-319b63f1-092a-41b4-8e8d-c4752bb7e44f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.104063 Sep 01 08:25:31.543817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1278/2583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:31 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:31.548236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:31.548826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:31.554687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.555164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.555590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.556296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.556742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.557154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.594225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.602567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e019b4c-4661-456c-9969-dfcf911db5ac tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086742 Sep 01 08:25:31.603142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1306/2584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:31 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:31.623312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.630958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f1625e97-df07-44ca-8c8a-3a6cd8649dc9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086205 Sep 01 08:25:31.631514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1279/2585] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:31 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:31.841578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:31.842180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:31.848187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.848668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.849102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.849780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.850230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.851397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.888594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:31.889313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:31.895350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.895901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.896406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.897255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:31.898250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:31.898972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:31.911452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.920157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.921590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.922730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f65e8d96-b819-4f05-93df-8cd8dad67932 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085150 Sep 01 08:25:31.923289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1307/2586] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:31 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:31.959292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:31.967494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5a296fe3-4324-42db-85bb-5a57c5109a18 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082715 Sep 01 08:25:31.968069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1280/2587] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:31 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:32.520505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:32.521113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:32.527522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.528004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.528442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.529131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.529578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.530003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.563626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:32.564326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:32.571507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.571996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.572424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.573121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.573572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.573987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.594924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:32.603279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47ab6790-90d8-4248-99d4-59dc68cfd44b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086670 Sep 01 08:25:32.603840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1308/2588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:32 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:32.623064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:32.623772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:32.629628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.630097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.630560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.631236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.631681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.632143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.639919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:32.647786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-631d5d2d-3eb6-4be7-b572-e8aeac13b995 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087917 Sep 01 08:25:32.648368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1281/2589] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:32 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:32.652762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:32.653366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:32.659388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.659867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.660300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.660977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.661425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.661843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.693312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:32.700990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1494f432-e618-4c11-bb99-7357d33b42fa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081588 Sep 01 08:25:32.701767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1309/2590] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:32 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:32.723235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:32.731276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-accd2adf-a541-4ee3-b340-8aafee9e46f1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081978 Sep 01 08:25:32.731840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1282/2591] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:32 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:32.945650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:32.946160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:32.952091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.952561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.952984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.953650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.954090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.954524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.988233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:32.988944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:32.995584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.996165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.997038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:32.997279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:32.997726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:32.998146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.015182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.023355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.024774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.025866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e59f6e6-a881-4dfd-92b5-bd5debd8b2b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084684 Sep 01 08:25:33.026440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1310/2592] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:32 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:33.062192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.064346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:33.071768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2deb0daa-6cfd-4ec3-a846-e0eafb4de808 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.087314 Sep 01 08:25:33.072322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1283/2593] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:32 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:33.624154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:33.624823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:33.630809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.631287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.631714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.632425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.632878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.633316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.636035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:33.669156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:33.669781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:33.676062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.676541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.676975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.677667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.678116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.678563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.695360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.703029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-83c1d310-4d10-4b46-b18b-2b5ddcc66872 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082727 Sep 01 08:25:33.714379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1311/2594] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:33 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:33.721312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:33.721871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:33.728675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.729150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.729574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.730250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.730716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.731131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.742970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.751326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-76402103-b3dd-46ad-944d-dcbbe1f8a567 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085960 Sep 01 08:25:33.751897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1284/2595] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:33 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:33.756282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:33.756920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:33.762887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.763376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.763811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.764493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:33.764940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:33.765364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:33.792762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.800465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0836e388-234f-4097-95c6-b80f7166c38f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082893 Sep 01 08:25:33.801031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1312/2596] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:33 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:33.830539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:33.839199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-75b4deb4-2f45-4886-a767-5c31445d1ca9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086371 Sep 01 08:25:33.839759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1285/2597] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:33 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:34.048711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:34.049287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:34.055230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.055696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.056119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.056787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.057233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.057650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.092268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:34.092865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:34.098790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.099275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.099699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.100388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.101654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.102082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.117715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.125912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.127376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.128469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4fcb8f36-76a6-4e37-8f11-e8dd267de2fc tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083646 Sep 01 08:25:34.129114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1313/2598] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:34 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:34.161845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.170061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a9142b6d-20b9-4b3a-9309-222b47063d8e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081710 Sep 01 08:25:34.170653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1286/2599] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:34 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:34.725023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:34.726204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:34.732269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.732756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.733184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.733879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.734354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.734772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.773020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:34.773745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:34.780113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.780336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.780757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.781440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.781890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.782325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.799472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.808280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fbb3137b-8d87-446d-9fd7-0fdab26b9309 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087043 Sep 01 08:25:34.809040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1314/2600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:34 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:34.820443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:34.821043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:34.827043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.827514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.827938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.828619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.829063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.829477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.857698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.865221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6d6725dd-03e9-4ea2-86ae-f203a183e27b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.096517 Sep 01 08:25:34.865779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1287/2601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:34 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:34.870280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:34.870879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:34.877065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.877524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.877948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.878649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:34.879102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:34.879653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:34.895671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.904220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-50d4a291-cc01-4987-854b-0443acc18591 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087319 Sep 01 08:25:34.904791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1315/2602] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:34 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:34.941100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:34.949216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8da3575c-1e73-4760-a6cb-ff922e83b194 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082448 Sep 01 08:25:34.949760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1288/2603] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:34 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:35.152088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:35.152722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:35.159603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.160076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.160503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.161175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.161618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.162031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.190925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:35.191625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:35.198029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.198532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.198959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.199638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.200081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.200495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.223559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:35.232171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:35.233589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:35.234905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a1a02c49-4cb7-4cfe-8467-501ed55b3ba2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087047 Sep 01 08:25:35.235454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1316/2604] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:35 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:35.264745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:35.273116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31896dcd-33ad-41b7-b11d-3d6d8fad2b60 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085277 Sep 01 08:25:35.273687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1289/2605] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:35 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:35.829049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:35.829652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:35.837498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.837979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.838484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.839176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.839625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.840046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.887859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:35.888480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:35.894542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.895026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.895461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.896157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.896610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.897036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.906889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:35.915037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d65563f5-16ad-49a2-b501-654f027a72f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089694 Sep 01 08:25:35.915621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1317/2606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:35 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:35.924693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:35.925474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:35.931854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.932337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.932767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.933459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.934015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.934472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.963040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:35.971353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8082234-c9e7-4b3a-a372-6eef6ba097bf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087410 Sep 01 08:25:35.971912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1290/2607] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:35 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:35.977145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:35.977761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:35.983605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.984089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.984664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.985349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:35.985794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:35.986219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:35.999020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:36.006652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a30a62e1-c433-4152-ba22-b6150807ecfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085706 Sep 01 08:25:36.008418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1318/2608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:35 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:36.049235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:36.057349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b0df88c-facb-48c0-a2d0-d12699d7bddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084512 Sep 01 08:25:36.057905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1291/2609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:35 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:36.257470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:36.258061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:36.266054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:36.266575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:36.267013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:36.268194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:36.268658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:36.269081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:36.295256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:36.296083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:36.302077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:36.302620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:36.303057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:36.304292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:36.304745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:36.305169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:36.332733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:36.340928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:36.342421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:36.343523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7f83f566-1b9e-4dc4-b358-15d4f9a6c308 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089976 Sep 01 08:25:36.344074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1319/2610] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:36 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:36.366044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:36.374492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6cc57123-a611-424a-acf1-232f66ad935d tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.083186 Sep 01 08:25:36.375047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1292/2611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:36 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:36.939955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:36.940554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:36.947382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:36.947871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:36.948313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:36.949011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:36.949468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:36.949882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:36.992924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:36.993551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:36.999660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.000146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.000582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.001276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.001728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.002153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.015847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.024206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dcc58fe2-8a43-4f7a-84be-08311de696d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088080 Sep 01 08:25:37.031761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1320/2612] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:36 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:37.035590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:37.036213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:37.042715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.043203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.043633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.044324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.044776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.045200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.070733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.078651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31016bbc-0995-416d-91ea-d6f9d4c0d9ea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090132 Sep 01 08:25:37.079222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1293/2613] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:36 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:37.083917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:37.084513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:37.091148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.091628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.092060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.092746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.093193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.093628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.107311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.115027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e3144597-6251-4820-a5ec-68c3f4ddbc0d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089249 Sep 01 08:25:37.115595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1321/2614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:37 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:37.155308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.162827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f1a46ab5-250b-4ebb-a842-60a5c55e95f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082673 Sep 01 08:25:37.163402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1294/2615] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:37 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:37.365394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:37.365999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:37.372108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.372586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.373015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.373687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.374135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.374581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.394840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:37.395447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:37.402049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.402572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.403002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.403682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:37.405121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:37.405550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:37.435769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.445695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.447187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.448287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c64157e-7790-455f-849e-bfb76a134323 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086719 Sep 01 08:25:37.448850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1322/2616] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:37 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:37.469166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:37.477035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0266edd4-363f-4bc0-b4fb-d0a45bc84c2a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.085908 Sep 01 08:25:37.477588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1295/2617] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:37 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:38.045092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:38.045694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:38.047669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:25:38.047803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 (ip 10.222.0.43) !!! Sep 01 08:25:38.054014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.054567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.055004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.055750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.056195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.056616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.100140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:38.101512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:38.107758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.108226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.108653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.109337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.109779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.110197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.121578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.129446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0422e60d-cc29-4fb1-afa3-d9415c8b0810 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088155 Sep 01 08:25:38.130350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1323/2618] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:38 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:38.136307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:38.136906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:38.142880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.143387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.143816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.144494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.144944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.145362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.174240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.184161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9d6d9e3c-1554-42ba-83f1-1afff6b6a272 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087911 Sep 01 08:25:38.184734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1296/2619] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:38 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:38.189532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:38.190131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:38.196982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.197469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.197900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.198621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.199073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.199493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.208861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.217764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-de2214f9-3b7e-4b6e-adbb-90fc61ef8205 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085313 Sep 01 08:25:38.218796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1324/2620] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:38 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:38.266532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.274685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-892469cd-ab46-4966-9610-9cb73fa0c3d9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088881 Sep 01 08:25:38.275271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1297/2621] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:38 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:38.471516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:38.471778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:38.478201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.478853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.479228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.479925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.480372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.480843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.496991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:38.497632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:38.503421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.503903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.504339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.505025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:38.505478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:38.505900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:38.541144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.550179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.551932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.552888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6eef8291-1c15-43af-b222-f99aca43b9be tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085617 Sep 01 08:25:38.553381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1325/2622] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:38 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:38.579325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:38.587572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-72850497-353b-4322-a1a0-fa75c2f55557 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.094322 Sep 01 08:25:38.588134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1298/2623] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:38 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:39.150577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:39.151285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:39.157405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.157886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.158345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.159043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.159491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.159911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.205029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:39.205636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:39.212884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.213365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.213797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.214524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.214972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.215390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.222880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.231277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-101e8e6b-5275-429c-a233-2b5e2d38ca45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085080 Sep 01 08:25:39.231852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1326/2624] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:39 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:39.238700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:39.239303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:39.245339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.245821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.246253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.246968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.247416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.247836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.279868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.287494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-164d8f75-2201-4e99-a63b-e5171dec9aaf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086370 Sep 01 08:25:39.288060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1299/2625] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:39 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:39.295206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:39.295802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:39.301632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.302101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.302561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.303227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.303713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.304240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.309537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.311776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:39.318506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d5c842ef-223a-4328-affd-6d5558befa92 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083433 Sep 01 08:25:39.319312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1327/2626] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:39 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:39.319507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:39.366034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.373607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-45b59ed1-786d-4566-bc63-2fdc276875b7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082036 Sep 01 08:25:39.374158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1300/2627] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:39 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:39.576498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:39.577097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:39.583317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.583794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.584217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.584894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.585965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.586403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.608753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:39.609350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:39.615295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.615773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.616240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.616926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:39.617374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:39.617791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:39.646100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.655034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.656669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.658893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aa9615f1-a415-448f-b48e-a6b168d10b06 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085217 Sep 01 08:25:39.659871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1328/2628] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:39 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:39.687668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:39.695949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-95b4dd1a-b877-47b3-b96c-c3f9b823a178 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090935 Sep 01 08:25:39.696507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1301/2629] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:39 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:40.252297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:40.252904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:40.260115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.260601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.261310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.262131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.262579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.263226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.309395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:40.309999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:40.315998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.316482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.316916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.317610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.318059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.318502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.328289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.337734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-86f393a1-8970-4f3e-b090-86327c22ffaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089180 Sep 01 08:25:40.341222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1329/2630] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:40 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:40.342939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:40.343664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:40.350385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.351798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.351798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.352165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.352616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.353036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.390966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.399434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e70aa648-4656-4130-911a-2c9a6ac49dff tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.093846 Sep 01 08:25:40.400012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1302/2631] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:40 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:40.404703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:40.405302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:40.411709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.412139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.412653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.413927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.414396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.414821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.418826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.426635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-39fa2262-29e0-4564-aaa0-a0ad65e20f16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087299 Sep 01 08:25:40.427192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1330/2632] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:40 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:40.476857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.484421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a67a0d9e-114e-4acf-8a51-0aa0b3af7bb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083474 Sep 01 08:25:40.484976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1303/2633] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:40 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:40.682194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:40.682727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:40.688693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.689172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.689606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.690303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.690758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.691173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.717165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:40.717916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:40.723792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.724263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.724688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.725355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:40.725805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:40.726210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:40.753145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.761406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.762884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.763982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-095e6a52-0239-4453-8df2-85f4f1998bbb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085770 Sep 01 08:25:40.764725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1331/2634] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:40 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:40.787317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:40.795790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-94ffa692-5e69-4c6c-bd4f-e8e9379d4cf2 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.082410 Sep 01 08:25:40.796351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1304/2635] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:40 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:41.365754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:41.365754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:41.366485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.366729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.367154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.367833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.368292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.368691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.419867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:41.420485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:41.426918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.427406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.428424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.428556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.428987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.429411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.430158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.438626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed9d4656-7fa3-46e5-9ae6-2199b7afa138 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082887 Sep 01 08:25:41.439419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1332/2636] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:41 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:41.457694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:41.458542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:41.465540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.466025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.466496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.467181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.467631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.468056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.493306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.501144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2829c30-204e-4c96-a9db-e03e19d0bb1f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085752 Sep 01 08:25:41.501718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1305/2637] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:41 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:41.506103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:41.506737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:41.512648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.513137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.513574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.514282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.514775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.515196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.532282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.540321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7cccc57-5338-4721-8518-c7a358f4b4c6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086727 Sep 01 08:25:41.547999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1333/2638] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:41 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:41.579437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.587929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-974e994c-9ef6-4169-b0c4-274634f2d4e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085258 Sep 01 08:25:41.588727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1306/2639] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:41 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:41.786988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:41.787592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:41.793704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.794176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.794636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.795302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.795743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.796153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.816570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:41.817301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:41.823873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.824354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.824781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.825463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:41.825908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:41.826353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:41.856528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.864828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.866640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.868027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0fbadff3-85e1-489d-b6f8-5541bc02b9d0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084717 Sep 01 08:25:41.868587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1334/2640] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:41 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:41.886958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:41.894541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d16b524-dd14-493e-be09-9b34e18d733e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.081768 Sep 01 08:25:41.895087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1307/2641] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:41 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:42.462277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:42.462938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:42.469383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.469872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.470331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.471031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.471998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.471998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.521134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:42.521847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:42.528740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.529227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.529662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.530426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.530884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.531305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.542500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:42.555629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3db53db0-4293-4216-8b00-03ab00d17886 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.097864 Sep 01 08:25:42.556724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1335/2642] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:42 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:42.567390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:42.568099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:42.575419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.575926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.576345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.577077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.577526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.577946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.603903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:42.611824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4e9704b8-66b4-45da-b1b5-dbb9e532948c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094672 Sep 01 08:25:42.612391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1308/2643] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:42 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:42.616718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:42.617313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:42.623651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.624130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.624557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.625241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.625788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.626355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.640888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:42.650333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41f6a024-a1f5-402b-bbce-1b53090a7d9d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085852 Sep 01 08:25:42.651071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1336/2644] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:42 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:42.689666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:42.698357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-546c65ff-a2ff-4701-9e9a-41e62d093b08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084963 Sep 01 08:25:42.698993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1309/2645] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:42 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:42.893624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:42.894141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:42.900213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.900682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.901109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.901783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.902225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.902664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.914537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:42.915459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:42.921290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.921771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.922202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.922992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:42.923444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:42.923868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:42.973316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:42.981525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:42.982985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:42.984068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-077805b7-13cf-4afc-b6bd-e85c623cdb5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094415 Sep 01 08:25:42.984617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1337/2646] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:42 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:42.992318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd69ef83d23d49fcbedcd308b1edf957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4336b9623424da8982f8a56ddee5a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:43.000924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ab3d3291-e8e7-47d3-a1e9-30ddb5bc3254 tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 200 len: 1139 microversion: 2.1 time: 0.090273 Sep 01 08:25:43.001466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1310/2647] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:42 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:43.021927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:43.022449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:43.029210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.029743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.030169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.030873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.031311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.031723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.056155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:25:43.064943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.065412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.065839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.078889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lazy-loading 'flavor' on Instance uuid 480c7727-3ce9-4749-be3f-4385df266d13 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:25:43.092409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lazy-loading 'system_metadata' on Instance uuid 480c7727-3ce9-4749-be3f-4385df266d13 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:25:43.109716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lazy-loading 'metadata' on Instance uuid 480c7727-3ce9-4749-be3f-4385df266d13 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:25:43.242042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Deleted allocations for instance 480c7727-3ce9-4749-be3f-4385df266d13 Sep 01 08:25:43.254298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:43.261158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-73510892-5900-47e7-ad9a-1a36799e801f tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "DELETE /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 204 len: 0 microversion: 2.1 time: 0.243386 Sep 01 08:25:43.261775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1338/2648] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:25:43 2022] DELETE /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:25:43.269856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:43.270498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] [instance: 480c7727-3ce9-4749-be3f-4385df266d13] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:43.276743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.277234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.277669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.278410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.278943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.279367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.294599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] HTTP exception thrown: Instance 480c7727-3ce9-4749-be3f-4385df266d13 could not be found. Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Request method failure captured: Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 HTTP/1.1 Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGsEHXTs0Dtr2XAUKN1rXneBf-xYTci788CRZ8TfwjXrxt-SSeVR4rOQBz1PapMIT5AqvZNPeR7hWZFRudAjsI_AOVpyuBbtUZtiQ4FRZEFAdVxUfJmQaBmSmER3tgK6jVxuNJrnV-ZwdPblrJPZcMtbrB2cGxxHG7sINrMs6kMpb2o Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: f4336b9623424da8982f8a56ddee5a7a Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-TestShelveInstance-731499969 Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:25:43.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4336b9623424da8982f8a56ddee5a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4336b9623424da8982f8a56ddee5a7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f4336b9623424da8982f8a56ddee5a7a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f4336b9623424da8982f8a56ddee5a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-TestShelveInstance-731499969 Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: f4336b9623424da8982f8a56ddee5a7a Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-TestShelveInstance-731499969 Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-TestShelveInstance-731499969-project Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: bd69ef83d23d49fcbedcd308b1edf957 Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-TestShelveInstance-731499969-project Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance 480c7727-3ce9-4749-be3f-4385df266d13 could not be found. Sep 01 08:25:43.297829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '480c7727-3ce9-4749-be3f-4385df266d13'} Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480c7727-3ce9-4749-be3f-4385df266d13 could not be found. Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:25:43.298732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480c7727-3ce9-4749-be3f-4385df266d13 could not be found. Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480c7727-3ce9-4749-be3f-4385df266d13 could not be found. Sep 01 08:25:43.300160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:25:43.301293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Returning 404 to user: Instance 480c7727-3ce9-4749-be3f-4385df266d13 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:25:43.301293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-052d151b-6096-40b6-b335-3a079aaecb3e tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13" status: 404 len: 111 microversion: 2.1 time: 0.031571 Sep 01 08:25:43.301293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1311/2649] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:43 2022] GET /compute/v2.1/servers/480c7727-3ce9-4749-be3f-4385df266d13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:25:43.460098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09d58bd5-ce43-494b-aaf1-7b022ea7259a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] Calling method '.version_select at 0x7f2abf0f4430>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:43.484434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09d58bd5-ce43-494b-aaf1-7b022ea7259a tempest-TestShelveInstance-731499969 tempest-TestShelveInstance-731499969-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1481646264" status: 202 len: 0 microversion: 2.1 time: 0.028867 Sep 01 08:25:43.492212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1339/2650] 10.222.0.43 () {58 vars in 1254 bytes} [Thu Sep 1 08:25:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1481646264 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 08:25:43.581534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:43.582445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:43.589145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.589626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.590059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.590778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.591231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.591651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.632399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:43.633038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:43.641086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.641567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.642176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.643104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.643556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.643977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.658962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:43.669060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b87029a7-28b4-439d-978f-042cad1a0f5a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.091310 Sep 01 08:25:43.669630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1312/2651] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:43 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:43.675645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:43.676813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:43.686814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.687385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.688054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.688746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.689197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.689621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.716904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:43.724272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3a97ba9-c1ed-4451-84af-18248b7a4926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.095891 Sep 01 08:25:43.724829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1340/2652] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:43 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:43.735846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:43.736782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:43.743813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.744294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.744736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.745399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:43.745838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:43.746803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:43.751791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:43.758327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:43.766962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aaebe04c-4883-4408-8dc8-8ddb36723005 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.096052 Sep 01 08:25:43.767866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1313/2653] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:43 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:43.838472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:43.846104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7c7daaeb-9788-4be5-8e68-edc7c89cbc8b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.119991 Sep 01 08:25:43.846736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1341/2654] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:43 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:44.007566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:44.008084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:44.015041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.015526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.016429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.016668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.017118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.017542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.100723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:44.109371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:44.110873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:44.112015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a5f5dd5-eb85-434f-8312-ed86aac85d73 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.108481 Sep 01 08:25:44.112565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1314/2655] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:44 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:44.692184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:44.693350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:44.706231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.706747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.707458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.708190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.708644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.709066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.747469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:44.748701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:44.754735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.755216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.755640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.756331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.756775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.757230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.790972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:44.798688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fa01bdb2-a68e-45ad-bd76-769bd7cad454 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.112826 Sep 01 08:25:44.799254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1342/2656] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:44 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:44.803732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:44.804583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:44.811788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.812275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.812891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.813578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.814021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.814466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.827661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:44.838742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f153d2f3-6223-4ace-a0d2-f8bd810297ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.095857 Sep 01 08:25:44.839327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1315/2657] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:44 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:44.867112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:44.867248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:44.873190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:44.879299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.880039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.880467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.881155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:44.881767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:44.882181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:44.908898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:44.918796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1cefdcf1-1f77-4e82-9230-5078672af654 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.118473 Sep 01 08:25:44.920221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1343/2658] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:44 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:44.965390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:44.976197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3b377f00-9f1b-4954-bf99-d390144e8573 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.113153 Sep 01 08:25:44.978080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1316/2659] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:44 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:45.135143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:45.135807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:45.141743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.142330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.142857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.143625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.144145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.144640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.208783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:45.217303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:45.218971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:45.220209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-619ccfef-7e1b-4f2d-b782-ac31071b9bd2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089547 Sep 01 08:25:45.220825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1344/2660] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:45 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:45.820430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:45.821236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:45.827621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.828109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.828543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.829237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.829696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.830112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.859322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:45.860675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:45.867050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.867725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.868251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.869062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.869592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.870084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.933304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:45.935797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:45.942967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-40d7b1b4-a6a4-4372-afa5-6c60fe1f9914 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.126328 Sep 01 08:25:45.943919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1317/2661] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:45 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:45.948914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:45.949523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:45.953490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:45.955845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.956310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.956947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.957920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:45.958406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:45.958858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:45.970803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9a6ed3f8-ca04-423d-85e6-8ccdb1aa031c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.115027 Sep 01 08:25:45.971713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1345/2662] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:45 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:45.997489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:45.998601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:46.010809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:46.011402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:46.012116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:46.012919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:46.013429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:46.013931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:46.201888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:46.209862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dfb5749a-3521-4f32-97d1-b768fdde9a95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.265140 Sep 01 08:25:46.210394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1318/2663] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:45 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:46.219797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:46.228572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2b3707a6-e9a5-42df-8f65-0670a9c57475 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.234762 Sep 01 08:25:46.229410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1346/2664] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:45 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:46.245196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:46.245910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:46.251730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:46.252206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:46.252636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:46.253315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:46.253758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:46.254366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:46.345528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:46.355551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:46.357595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:46.359357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8cafe103-f3ea-4b0a-8125-d279bcb35879 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.118178 Sep 01 08:25:46.360459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1319/2665] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:46 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:46.964389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:46.965844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:46.972807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:46.973506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:46.973942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:46.974693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:46.975150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:46.975575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:46.994096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:47.001974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:47.016709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.017608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.018361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.019104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.019757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.020394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.073615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:47.081463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4bee87b9-f59c-480b-b273-51d799fdaf9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.121205 Sep 01 08:25:47.082640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1347/2666] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:46 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:47.153126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:47.161805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4b3c0d4f-acc4-43ca-9260-367fb8a60fea tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.172422 Sep 01 08:25:47.162412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1320/2667] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:46 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:47.231629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:47.232586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:47.238665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.239382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.240067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.240963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.241608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.242223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.249089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:47.250052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:47.261187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.261664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.262107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.262852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.263316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.263725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.351186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:47.360016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-68011ae6-e7bb-4376-bf4b-22a9b1e11363 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.132700 Sep 01 08:25:47.360597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1348/2668] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:47 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:47.382859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:47.386566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:47.390456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:47.397333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-38758766-d54c-42b8-95b8-03a5fbfb28eb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.152008 Sep 01 08:25:47.397905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1321/2669] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:47 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:47.401386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.401866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.402310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.402997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:47.403437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:47.403848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:47.473919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:47.482191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:47.483636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:47.484719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-82e010c0-ef8c-4c90-88c4-30fd9c39a7d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.105775 Sep 01 08:25:47.485259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1349/2670] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:47 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:48.103928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:48.104532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:48.110415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.110902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.111497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.112211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.112652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.113065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.175725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:48.182925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:48.183533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:48.183690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-131e3f2d-6696-4762-9c45-0ec75fabe969 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084504 Sep 01 08:25:48.184464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1322/2671] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:48 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:48.191589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.192451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.192856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.193550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.194132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.194591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.258934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:48.266739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e8ee3b2-3eeb-4ac4-8b8c-ab2521f641b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087534 Sep 01 08:25:48.267319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1350/2672] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:48 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:48.381277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:48.381643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:48.388692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.389174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.389606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.390327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.390778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.391197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.420333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:48.421245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:48.427853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.428629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.429267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.430252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.430980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.431611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.457342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:48.470141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f4b66281-0ba4-47c6-bb2c-8cfaddac5eb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089922 Sep 01 08:25:48.470141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1323/2673] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:48 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:48.514563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:48.515199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:48.528682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.531647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.532529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.533429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:48.534275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:48.535034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:48.539411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:48.549133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a677aca9-ba54-4005-b81e-667597e862d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.134502 Sep 01 08:25:48.549719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1351/2674] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:48 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:48.685656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:48.694810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:48.697316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:48.698658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-01316837-46b8-457c-9d29-ab65ff50441e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.192995 Sep 01 08:25:48.699344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1324/2675] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:48 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:49.204579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:49.205945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:49.212697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.213181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.213613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.214328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.214780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.215199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.288308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:49.290344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:49.296816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.297576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.298211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.299124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.299762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.300390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.374553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:49.383954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95b7c296-e075-40ed-b8bc-a41674c5d252 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.183048 Sep 01 08:25:49.384537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1352/2676] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:49 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:49.403435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:49.411483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ffa5b9a4-97c0-443e-aca3-536ec53ed289 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.126892 Sep 01 08:25:49.412157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1325/2677] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:49 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:49.487868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:49.488703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:49.495043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.495596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.496110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.496890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.497545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.498024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.569694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:49.570830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:49.577037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:49.577483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.577978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.578437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.579336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.579944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.580738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.593908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3fe9d81-d99b-48bb-b04a-18c4feaa280e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.109653 Sep 01 08:25:49.595774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1353/2678] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:49 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:49.658564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:49.669182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-931624c3-dd56-473c-af57-7d05be0e1bdc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.102024 Sep 01 08:25:49.669182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1326/2679] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:49 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:49.721090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:49.721769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:49.728938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.729745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.729896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.730632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:49.731087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:49.731518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:49.801768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:49.811156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:49.812617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:49.813761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-92e4afec-6f2c-41d6-8195-30d410cb8aec tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096660 Sep 01 08:25:49.814385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1354/2680] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:49 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:50.407586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:50.408882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:50.420279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.420824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.421177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.421871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.422340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.422759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.434357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:50.435861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:50.450781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.451658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.452267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.453160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.453774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.455328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.719079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:50.725148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:50.729750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30953b47-d246-42e0-8beb-78e343e0b39f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.299970 Sep 01 08:25:50.736042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0b549ed7-d767-4641-ac77-0c9958f78b0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.334451 Sep 01 08:25:50.736885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1327/2681] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:50 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:50.743556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1355/2682] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:50 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:50.744819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:50.745730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:50.748642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:50.749487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:50.755774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.756248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.756676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.757545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.758213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.758846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.760879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.761570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.762726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.763661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.764118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.764694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.891971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:50.901568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7df00aac-2c67-4dbf-9b8a-953fc5113247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.156881 Sep 01 08:25:50.902443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1356/2683] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:50 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:50.915120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:50.915120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70b5ae0a-ffe8-4b7e-b781-6ff8fd2a805d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.172996 Sep 01 08:25:50.915120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1328/2684] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:50 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:50.916839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:50.917529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:50.923793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.925852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.926550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:50.927274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:50.927733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:50.928585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.029630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:51.038281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:51.039790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:51.040941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e5594fcf-86fc-4e0e-a328-5e68f89185eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.128282 Sep 01 08:25:51.041506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1329/2685] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:50 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:51.754250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:51.754899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:51.756566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:51.757169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:51.762787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.763383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.763513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.763818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.763980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.764314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.764508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.764960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.765090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.765369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.765614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.765868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.842557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:51.846206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:51.851802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7aa5d791-b67c-4fb7-9595-ffa66781063e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.101323 Sep 01 08:25:51.852805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1357/2686] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:51 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:51.858803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:51.866412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e237e4c-b08e-4c24-a755-37962c5833b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.113478 Sep 01 08:25:51.867005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1330/2687] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:51 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:51.924697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:51.926616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:51.931976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.932135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:51.932449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.932905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.933071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:51.933598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.934031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.934484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.939576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.939990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.940418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:51.941303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:51.941919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:51.942371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:52.042360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:52.045345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:52.052952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e550433-546e-444a-84bb-d4472f27d951 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.132511 Sep 01 08:25:52.053531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1358/2688] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:51 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:52.064660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:52.065155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:52.067324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1935160d-442a-416e-84f4-5ab1f1005b39 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.126098 Sep 01 08:25:52.068109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1331/2689] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:51 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:52.072187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:52.072931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:52.073369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:52.074068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:52.074561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:52.074983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:52.139370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:52.147964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:52.149627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:52.151793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-193c1dd2-4602-46ae-b0c9-1332ba103c2d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090976 Sep 01 08:25:52.152931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1359/2690] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:52 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:52.873127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:52.873767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:52.879925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:52.880407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:52.880839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:52.881663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:52.882116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:52.882561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:52.886748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:52.887352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:52.893478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:52.893957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:52.894444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:52.895135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:52.895582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:52.896027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:52.955367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:52.963695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-76b0c2bc-9371-4098-9d29-96c9ba422caf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094437 Sep 01 08:25:52.964466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1332/2691] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:52 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:52.972173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:52.982922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce0ab5b2-fc3c-42b3-8df7-605202434e11 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.100003 Sep 01 08:25:52.983493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1360/2692] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:52 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:53.075001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:53.075529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:53.081418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.081899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.082625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:53.083304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.083754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.084207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:53.089421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:53.090018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:53.096438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.096918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.097340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:53.098026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.098496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.098915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:53.155782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:53.163778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e1fa268-ded6-4a2f-a5e5-0580a9935405 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.092753 Sep 01 08:25:53.177624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1333/2693] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:53 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:53.178011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:53.178128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:53.178128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:53.180884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b14cfa1-66bf-4801-ae8b-672957baaed1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.094755 Sep 01 08:25:53.181453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1361/2694] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:53 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:53.191788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.191788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.191788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:53.191788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.192312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.192312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:53.204591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:53.252510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:53.260782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:53.262213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:53.263341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7dfda273-be57-47b9-92fa-248d626516f9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091710 Sep 01 08:25:53.263908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1334/2695] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:53 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:53.984223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:53.984860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:53.991965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.992480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.993772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:53.994527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:53.994982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:53.995432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.004358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:54.005079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:54.011797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.012274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.012706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.013385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.013829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.014243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.072129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:54.079849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28e8ae87-6092-40ba-a110-b275c2f7673d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.099414 Sep 01 08:25:54.080415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1362/2696] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:53 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:54.092033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:54.099736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26bd5f5c-4a63-4bfc-8898-c5c577702754 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.099612 Sep 01 08:25:54.100281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1335/2697] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:53 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:54.185195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:54.185804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:54.191725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.192204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.192634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.193313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.193761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.194182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.200964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:54.201565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:54.207591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.208093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.208517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.209196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.209639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.210050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.263684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:54.271500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bd31a3dd-53ce-4159-ad90-e860ac1d2daa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090061 Sep 01 08:25:54.272068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1363/2698] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:54 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:54.284445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:54.291141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:54.291754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:54.292964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-925ae68b-d82b-4765-b176-7e53bbc72ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095676 Sep 01 08:25:54.293547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1336/2699] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:54 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:54.298155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.298671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.299098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.299782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:54.300225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:54.300639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:54.371978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:54.381870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:54.383885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:54.385148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4955e700-7284-48a1-b14d-16ee2b4aa825 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.098520 Sep 01 08:25:54.385703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1364/2700] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:54 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:55.100767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:55.101367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:55.108133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.108608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.109037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.109714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.110153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.110599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.120071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:55.120793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:55.126837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.127323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.127753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.128440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.128891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.129312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.183075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:55.190561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-449152c8-3aa5-44f9-bb67-4d86fa0ea8c2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.093594 Sep 01 08:25:55.191125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1337/2701] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:55 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:55.199155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:55.206658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7394abe-0271-442d-8908-6e41842d77b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.091128 Sep 01 08:25:55.207473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1365/2702] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:55 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:55.293701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:55.294310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:55.300235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.300713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.301141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.301812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.302355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.302774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.312744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:55.313592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:55.319395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.319866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.320291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.320982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.321428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.321845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.374136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:55.382432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c01a9291-1ff7-478e-b615-2f819f3cb19e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.092772 Sep 01 08:25:55.383559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1338/2703] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:55 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:55.395269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:55.403527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-681f6482-8797-4626-bd92-06d94e526933 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.094439 Sep 01 08:25:55.404090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1366/2704] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:55 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:55.408973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:55.409668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:55.416371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.416849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.417282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.417975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:55.418444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:55.418866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:55.487826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:55.496480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:55.497925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:55.499095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cd9b8df6-572b-4ff1-9210-567b06568bc9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094558 Sep 01 08:25:55.499622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1339/2705] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:55 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:56.212255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:56.212866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:56.218767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.219242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.219670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.220341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.220788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.221204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.226790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:56.228253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:56.234218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.234736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.235171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.235860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.236865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.236865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.290970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:56.298726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41672258-e170-48ce-887f-5fc8d7d277db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090730 Sep 01 08:25:56.299303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1367/2706] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:56 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:56.311184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:56.318776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cf1ef54f-4b10-49b1-8030-9ccf2b6860f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.095711 Sep 01 08:25:56.319334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1340/2707] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:56 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:56.405179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:56.405869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:56.411909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.412386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.412810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.413493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.413963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.414393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.424785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:56.425420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:56.432431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.432914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.433337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.434040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.434516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.434932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.490245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:56.498396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9c0b8e4-86de-4836-9342-ed0f4ee4e01e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.096919 Sep 01 08:25:56.498978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1368/2708] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:56 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:56.511312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:56.519503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9be83950-6b13-48a2-91c5-3bbe67a0977c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.098544 Sep 01 08:25:56.520207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1341/2709] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:56 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:56.521150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:56.521811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:56.528761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.529244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.529678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.530750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:56.531307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:56.531687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:56.602913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:56.611328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:56.612741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:56.613820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a9163b1-b19d-40ab-ab01-a6af9e7cc1a5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096816 Sep 01 08:25:56.614443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1369/2710] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:56 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:25:57.319597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:57.320184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:57.326721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.327203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.327631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.328306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.328746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.329162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.339950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:57.340557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:57.346513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.346989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.347421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.348105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.348551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.348970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.397909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:57.406240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8f740f3a-cd0e-4062-973b-8aabc285d1f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090716 Sep 01 08:25:57.406838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1342/2711] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:57 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:57.417708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:57.425379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d68f6ff-f79e-4e2b-af9c-25991a5ca3fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089962 Sep 01 08:25:57.425925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1370/2712] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:57 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:57.518286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:57.518887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:57.525114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.525597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.526028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.526730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.527179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.527600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.540439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:57.541050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:57.547130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.547703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.548073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.548761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.549213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.549633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.590983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:57.598717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3cced22b-6a3b-4d3b-8bd8-c2c89a5b05ff tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084151 Sep 01 08:25:57.599627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1343/2713] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:57 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:57.618931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:57.626634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-35e76fa1-fe3c-4012-ba4a-08eb6cd167f5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090349 Sep 01 08:25:57.627208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1371/2714] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:57 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:57.635707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:57.636302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:57.642385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.642860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.643314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.643983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:57.644423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:57.644833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:57.716560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:57.724649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:57.726073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:57.727794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-30940dc1-eee4-4136-b510-68d455c2e038 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095304 Sep 01 08:25:57.728353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1344/2715] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:57 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:58.426790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:58.427398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:58.434126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.434628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.435058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.435747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.436189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.436643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.445072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:58.445683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:58.451763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.452238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.452667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.453342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.453783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.454196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.503494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:58.511385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-906d9214-97fb-4eac-b659-154a06fcfdd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088288 Sep 01 08:25:58.511951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1372/2716] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:58 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:58.530000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:58.537721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ae340e40-7283-4cc0-9b91-8f54495f5450 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.096699 Sep 01 08:25:58.538313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1345/2717] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:58 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:58.620355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:58.620951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:58.626849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.627320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.627774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.628445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.628889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.629300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.646980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:58.647513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:58.654434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.654919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.655349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.656032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.656478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.656897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.689487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:58.697507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7d01c5e-3011-4cfb-b168-3647f7cf1487 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081072 Sep 01 08:25:58.698078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1373/2718] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:58 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:58.718424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:58.726213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0138d5b-e52f-4f5f-ac15-4dd235126864 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083029 Sep 01 08:25:58.726807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1346/2719] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:58 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:58.754929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:58.755529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:58.762610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.763096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.763525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.764217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:58.764657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:58.765070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:58.784418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:58.832070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:58.841425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:58.842914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:58.844018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-19334f66-4ba2-46eb-80a0-3585c444f1eb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093007 Sep 01 08:25:58.844575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1374/2720] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:58 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:25:59.532312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:59.533029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:59.539156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.540212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.540649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.541383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.541826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.542242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.559532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:59.560137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:59.566530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.567177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.567611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.568381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.568794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.569214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.607939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:59.618701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d041e88d-f9c0-4ca4-9786-c1cf8f759b12 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090048 Sep 01 08:25:59.619306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1347/2721] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:59 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:59.637665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:59.646558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9278b980-01e5-49e3-8b8a-3553979f73ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090882 Sep 01 08:25:59.647154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1375/2722] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:59 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:59.718795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:59.719394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:59.725264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.725674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.726100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.726793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.727458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.727876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.746827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:59.747620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:59.754550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.755220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.755775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.757240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.757764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.758822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.794235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:59.804942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f530e05e-f3eb-4d66-8b3a-e4f0bc0b4e7e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.089821 Sep 01 08:25:59.806798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1348/2723] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:59 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:25:59.831136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:59.840005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-522b22cb-1af2-4fd4-87fc-c3a9f47e1c16 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.096889 Sep 01 08:25:59.840790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1376/2724] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:25:59 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:25:59.865916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:25:59.866564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:25:59.873399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.873987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.874457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.875339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:25:59.875828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:25:59.876294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:25:59.943375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:59.952783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:59.954212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:25:59.955341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-797f3747-2148-4a31-b4ba-89a69106b32e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093308 Sep 01 08:25:59.955890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1349/2725] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:25:59 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:00.639079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:00.639702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:00.645539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.646009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.646471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.647152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.647651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.648004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.669168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:00.669760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:00.675557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.676027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.676454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.677132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.677574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.677986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.708655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:00.716817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2557c31d-ddb1-4d41-8786-222187a82996 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081498 Sep 01 08:26:00.717384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1377/2726] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:00 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:00.738407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:00.746439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf9992e6-8347-4bb2-97b3-55d920acd055 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080844 Sep 01 08:26:00.747062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1350/2727] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:00 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:00.826249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:00.826881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:00.833213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.833683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.834114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.834819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.835266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.835684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.860990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:00.861710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:00.868358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.868792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.869220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.869902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.870361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.870779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.873377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:00.900779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:00.908673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2875b34a-b0a4-4760-a541-4146e323ff5a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086095 Sep 01 08:26:00.909248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1378/2728] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:00 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:00.938534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:00.947008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1da05543-3dd8-414a-b085-063597f74572 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089935 Sep 01 08:26:00.947592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1351/2729] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:00 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:00.978592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:00.979215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:00.985486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.985978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.986457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:00.987155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:00.987606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:00.988027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.050233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:01.059572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:01.061003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:01.062101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9d1dd08a-4f68-4c6f-8c58-8aad06484d24 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087875 Sep 01 08:26:01.062706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1379/2730] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:00 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:01.738122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:01.738719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:01.745508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.745983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.746455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.747134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.747580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.748000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.766868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:01.767473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:01.773460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.773678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.774107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.776480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.776480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.776480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.810250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:01.818017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d7b28515-8f5e-4736-8404-1eeca6918b0e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083811 Sep 01 08:26:01.818616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1352/2731] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:01 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:01.838272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:01.845713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8277d563-033e-4c18-aeb2-397c82d81a20 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082588 Sep 01 08:26:01.846312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1380/2732] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:01 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:01.929341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:01.929950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:01.935994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.936472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.936906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.937587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.938036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.938481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.968233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:01.968831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:01.975161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.975645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.976072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:01.976851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:01.977328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:01.977942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:02.002817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:02.011851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-507ffb40-87ef-4411-9566-b180ac2fefb3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086202 Sep 01 08:26:02.012489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1353/2733] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:01 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:02.039401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:02.047090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f479a2ea-4400-422e-b6d7-d1c046a6e07c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082572 Sep 01 08:26:02.047658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1381/2734] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:01 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:02.085312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:02.085989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:02.093001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:02.093487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:02.093920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:02.094635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:02.095082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:02.095502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:02.159467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:02.168909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:02.170386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:02.171510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-77e226f1-5fc7-4733-9c57-fab414897845 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090357 Sep 01 08:26:02.172070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1354/2735] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:02 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:02.839117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:02.839727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:02.845939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:02.846463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:02.846888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:02.847561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:02.848004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:02.848414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:02.865940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:02.866570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:02.873192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:02.873668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:02.874097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:02.874800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:02.875240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:02.875654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:02.909507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:02.918056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-296e40b9-ad53-4792-9a71-c408ea914623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082670 Sep 01 08:26:02.918654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1382/2736] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:02 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:02.942474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:02.951001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-da63b2db-c644-41d8-8ba0-3265d853ef9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089136 Sep 01 08:26:02.951809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1355/2737] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:02 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:03.033113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:03.033715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:03.039755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.040227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.040652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.041325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.041781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.042180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.067433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:03.068037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:03.075355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.075840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.076275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.076959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.077407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.077826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.104671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:03.113302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5557d559-8bd0-4d23-82c2-a58b9b210943 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083927 Sep 01 08:26:03.113903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1383/2738] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:03 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:03.141933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:03.150386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b9c77db-cdc5-42e8-a8d5-d0be9d1442b9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086562 Sep 01 08:26:03.150965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1356/2739] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:03 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:03.198543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:03.199660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:03.210361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.211011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.211998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.212706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.213145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.213567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.274246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:03.282808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:03.284279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:03.285409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1254143e-238d-418a-bf93-97b7e5491875 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093614 Sep 01 08:26:03.285979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1384/2740] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:03 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:03.939112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:03.939700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:03.945564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.946035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.946493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.947160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.949447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.949885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.970897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:03.971493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:03.977439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.977912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.978361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:03.979240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:03.979689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:03.980101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:04.013139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:04.021103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c362781-c749-4b64-9dc5-b8952c051b23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085733 Sep 01 08:26:04.021672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1357/2741] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:03 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:04.041829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:04.050284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fa28e370-1f02-4b68-884b-f7796f492b84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083080 Sep 01 08:26:04.050847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1385/2742] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:03 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:04.135108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:04.135696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:04.141966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:04.142481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:04.142907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:04.143573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:04.144053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:04.144465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:04.170246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:04.170876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:04.176834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:04.177325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:04.177760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:04.178474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:04.178926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:04.179348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:04.205229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:04.213929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-510d598c-a956-4ced-be10-71c2ce5c2d2f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082539 Sep 01 08:26:04.214618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1358/2743] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:04 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:04.240796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:04.249205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-313bb6b8-6a90-4466-b8d9-f28170574407 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083148 Sep 01 08:26:04.249774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1386/2744] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:04 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:04.309674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:04.310288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:04.316228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:04.316698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:04.317124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:04.317803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:04.318243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:04.318679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:04.386081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:04.394618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:04.396045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:04.397140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0d5bf5e3-b01c-4aa8-b1ae-a742a72c3e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091932 Sep 01 08:26:04.397691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1359/2745] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:04 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:05.042776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:05.043389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:05.045264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:05.051374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.051852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.052273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.052975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.053417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.053830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.071648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:05.072259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:05.079206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.079624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.080060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.080754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.081211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.081699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.117950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:05.125696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24bcc784-be6d-48d4-a181-fe25ac4dfdc9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086643 Sep 01 08:26:05.126281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1387/2746] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:05 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:05.146535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:05.155314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e87ff049-5dbc-4c48-90ea-7ab18178f6cf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087411 Sep 01 08:26:05.155898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1360/2747] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:05 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:05.234303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:05.234905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:05.240851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.241324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.241749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.242573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.242890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.243309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.269963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:05.270590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:05.276579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.277052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.277482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.278165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.278673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.279047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.304429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:05.313465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cbac4497-9db2-449c-8215-3787adf9cf17 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082850 Sep 01 08:26:05.314352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1388/2748] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:05 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:05.345595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:05.353299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd181ff2-8b2f-4993-a956-1bf1d2ea31da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087095 Sep 01 08:26:05.353895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1361/2749] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:05 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:05.420078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:05.420684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:05.429350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.429840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.430287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.430986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:05.431434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:05.432358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:05.499240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:05.507596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:05.509004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:05.510698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0f563396-47c0-4991-b7fb-805f85117997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094056 Sep 01 08:26:05.511284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1389/2750] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:05 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:06.147608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:06.148389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:06.155714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.156265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.156697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.157374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.157814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.158227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.175894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:06.176502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:06.183202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.183722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.184160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.184847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.185294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.185712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.218967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:06.226651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-107e8456-7982-4b48-b8ee-439aabf4c59b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083599 Sep 01 08:26:06.227219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1362/2751] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:06 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:06.247003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:06.254856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0fe3bb57-491e-4d38-a703-52143fb160bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082933 Sep 01 08:26:06.255461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1390/2752] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:06 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:06.335280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:06.335879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:06.342190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.342694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.343124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.343792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.344232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.344649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.376378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:06.377103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:06.383167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.383645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.384138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.384835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.385406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.385819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.390158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:06.407814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:06.415405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee744459-5c47-48a0-b403-54978a5c0010 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084095 Sep 01 08:26:06.415969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1363/2753] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:06 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:06.449286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:06.456987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ecf31937-74a4-4179-9b44-6777c80ed947 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087509 Sep 01 08:26:06.457825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1391/2754] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:06 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:06.533201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:06.533808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:06.540723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.541131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.542136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.542944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:06.543584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:06.544077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:06.606962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:06.615407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:06.616840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:06.617952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3887050a-3b1f-4fb1-ab5e-eab800460c5f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088768 Sep 01 08:26:06.618638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1364/2755] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:06 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:07.248475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:07.249094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:07.254984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.255455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.255880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.256550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.256991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.257403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.275170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:07.276086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:07.281892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.282419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.283327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.283810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.284251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.284666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.316800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:07.324460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8a794a11-33ca-49fb-a3bf-98b019097c0a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080410 Sep 01 08:26:07.325032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1392/2756] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:07 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:07.347994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:07.358185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3e95ab7f-39ed-4f0e-8284-f428c885402f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086816 Sep 01 08:26:07.358786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1365/2757] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:07 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:07.436483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:07.437090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:07.443133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.443604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.444062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.444741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.445183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.445596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.476787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:07.477395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:07.481068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:07.485261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.485747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.486179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.486898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.487346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.487772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.507205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:07.514777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4feabb6e-f25b-4109-8181-4999194bdf46 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082082 Sep 01 08:26:07.515344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1393/2758] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:07 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:07.549284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:07.557247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-beecc518-4d83-4ea3-9fc8-3ea3dc027f34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084079 Sep 01 08:26:07.557827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1366/2759] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:07 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:07.640830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:07.641428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:07.647485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.647969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.648403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.649083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:07.649533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:07.649947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:07.711358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:07.721114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:07.722566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:07.723682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6de35eb6-cafa-4422-b8b3-3f651f97b9cd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086709 Sep 01 08:26:07.724252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1394/2760] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:07 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:08.345120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:08.345726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:08.351565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.352034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.352486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.353154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.353591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.354186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.378415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:08.379025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:08.385653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.386468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.387223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.388034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.390329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.391179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.421307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:08.423533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:08.430117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b401d41-4d56-49a1-a1d6-482b76a012e7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088796 Sep 01 08:26:08.430712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1367/2761] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:08 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:08.452831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:08.460811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-80a64393-a2be-4a2d-86e8-5f8082bf6f80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086185 Sep 01 08:26:08.461371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1395/2762] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:08 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:08.536191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:08.536796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:08.543542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.544020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.544452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.545149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.545596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.546026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.577060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:08.577670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:08.584008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.584486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.584915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.585659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.586111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.586552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.607967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:08.615596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8d0c0c62-7b54-4718-a90e-8f9552de1eab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083473 Sep 01 08:26:08.616162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1368/2763] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:08 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:08.649692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:08.657741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cbe4178a-7359-428b-bcd3-2487ef7f304b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084616 Sep 01 08:26:08.658326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1396/2764] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:08 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:08.750890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:08.751591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:08.757929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.758450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.758878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.759557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:08.760054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:08.760471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:08.828495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:08.837445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:08.838926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:08.840028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d265aa35-1a9b-4c56-8ece-d6f73dbcf312 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093489 Sep 01 08:26:08.840593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1369/2765] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:08 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:09.451674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:09.452256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:09.458350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.458822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.459248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.459914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.460362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.460775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.480822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:09.481420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:09.487281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.487865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.488181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.488852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.489300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.489712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.521993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:09.530433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-269bbbdd-55fb-450f-af7f-2e41a3b70f52 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083007 Sep 01 08:26:09.531119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1397/2766] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:09 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:09.550205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:09.557724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-11998b5d-44c4-430f-8356-c5d4b4d0738d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080752 Sep 01 08:26:09.558303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1370/2767] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:09 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:09.636806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:09.637457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:09.643517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.643994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.644422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.645095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.645540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.645955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.679097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:09.679701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:09.686245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.686760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.687216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.687950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.688401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.688822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.710694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:09.720581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-879f2074-dd98-47a1-a6e1-9a4f16f154bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087965 Sep 01 08:26:09.721072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1398/2768] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:09 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:09.755938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:09.764695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a96cffb-dc21-4b92-85cc-7f0619a9a023 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089411 Sep 01 08:26:09.765261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1371/2769] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:09 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:09.862931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:09.863534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:09.870070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.870591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.871109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.871797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:09.872252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:09.872669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:09.935157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:09.943822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:09.945249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:09.946384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02ee94a9-b28f-4309-99b2-258f07b313e3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087415 Sep 01 08:26:09.946955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1399/2770] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:09 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:10.551881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:10.552506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:10.558930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.559401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.559853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.560555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.560994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.561405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.578577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:10.579277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:10.585548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.586022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.586472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.587182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.587621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.588033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.624260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:10.631952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-960770dc-cc5d-46c1-8455-61a1917260ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083815 Sep 01 08:26:10.632525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1372/2771] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:10 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:10.650737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:10.658396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24d248f1-bc35-4a33-97c1-7065f30ecd92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083611 Sep 01 08:26:10.658879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1400/2772] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:10 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:10.743067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:10.743686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:10.750901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.751388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.751825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.752509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.752962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.753387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.784827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:10.785428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:10.792259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.792827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.793257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.793943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.794446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.794863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.820629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:10.829003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7595d065-a8b5-4805-b4a8-4b1878b17395 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090852 Sep 01 08:26:10.829678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1373/2773] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:10 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:10.858698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:10.866392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4738dcec-51e6-4925-a0e4-4d23f70663da tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085299 Sep 01 08:26:10.866962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1401/2774] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:10 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:10.968546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:10.969053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:10.975003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.975506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.975933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:10.976606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:10.977047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:10.977460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.039578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:11.049682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:11.051245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:11.052410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec1e9070-84d5-4999-9f09-1ee8e35f329a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087667 Sep 01 08:26:11.053092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1374/2775] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:10 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:11.653070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:11.653655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:11.660312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.660786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.661212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.661888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.662353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.662776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.679017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:11.679614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:11.685674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.686155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.686623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.687304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.687750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.688235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.722338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:11.729893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33438fb4-570d-4129-a5fb-949e80b7cd94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080718 Sep 01 08:26:11.730497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1402/2776] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:11 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:11.751511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:11.759156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f8ad7fe5-e64e-4bba-8132-1da391617a8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083897 Sep 01 08:26:11.759704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1375/2777] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:11 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:11.850029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:11.850648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:11.856796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.857268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.857697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.858401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.858845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.859254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.887253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:11.887848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:11.893897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.894417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.894848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.895556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:11.895999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:11.896416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:11.919922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:11.927818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7388a5e3-f425-4101-b93e-ee340fdb2c7d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081476 Sep 01 08:26:11.928691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1403/2778] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:11 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:11.958845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:11.966677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2b2573b2-d902-4a29-ac82-c8401c1798b2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083603 Sep 01 08:26:11.967245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1376/2779] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:11 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:12.078762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:12.079366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:12.085490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.085966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.086424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:12.087106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.087552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.087977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:12.152808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:12.161249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:12.162718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:12.163860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-59333f63-e806-4e0b-aedc-46ba25490d6d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088975 Sep 01 08:26:12.164420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1404/2780] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:12 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:12.750621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:12.751261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:12.757106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.757584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.758019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:12.758728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.759181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.759598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:12.780050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:12.780658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:12.786529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.787014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.787444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:12.788125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.788575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.788991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:12.821838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:12.830352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a07c5b9f-32a9-4ad1-b915-a7700d231469 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083621 Sep 01 08:26:12.830925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1377/2781] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:12 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:12.849836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:12.857723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ef1573f-e0c9-4845-bb23-4e320110d750 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082222 Sep 01 08:26:12.858303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1405/2782] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:12 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:12.949520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:12.950126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:12.956383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.956859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.957554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:12.958243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:12.958717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:12.959130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.019043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:13.027321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04ca84d8-124c-4b45-a337-74f742c618c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082218 Sep 01 08:26:13.028099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1378/2783] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:12 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:13.187275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:13.187916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:13.193757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.194238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.194700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.195380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.195828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.196241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.259774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:13.259983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:13.260301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:13.266723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.267128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.267567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.268255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.268670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:13.268820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.269105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.270115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:13.271258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9cebccc-c6b3-41eb-b158-2f43eaf23d58 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088610 Sep 01 08:26:13.271818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1379/2784] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:13 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:13.354115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:13.362434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-50b490b2-ce73-49df-9f1a-f5a5d1c77682 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.379118 Sep 01 08:26:13.362987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1406/2785] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:12 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:13.851055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:13.851687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:13.857970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.858493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.858933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.859608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.860060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.860479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.877820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:13.878478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:13.882097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:26:13.882240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 (ip 10.222.0.43) !!! Sep 01 08:26:13.887347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.887818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.888246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.888923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:13.889364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:13.889779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:13.927680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:13.936067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a12c620-854f-4c30-8b87-8a042ac470b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088773 Sep 01 08:26:13.936841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1380/2786] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:13 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:13.954014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:13.957588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:13.962734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b15601d8-b104-4c96-8505-e6e6614de896 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088600 Sep 01 08:26:13.963288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1407/2787] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:13 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:14.047124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:14.047725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:14.053918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.054543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.054993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.055648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.056093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.056516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.116642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:14.124735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bb78a8a4-eb29-4c51-9b87-154aef23ec87 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081384 Sep 01 08:26:14.125290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1381/2788] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:14 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:14.294033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:14.294654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:14.300532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.301011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.301441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.302114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.302595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.303021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.363465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:14.372336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:14.373687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:14.374847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a1076fea-e0b4-4efe-a17d-fef1e5cdd6a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085513 Sep 01 08:26:14.375398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1408/2789] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:14 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:14.387805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:14.389806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:14.400491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.401357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.402953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.403822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.404320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.405370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.474043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:14.482320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a3564ed-6994-4050-8798-b579a9ec44cc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.101900 Sep 01 08:26:14.482885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1382/2790] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:14 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:14.956892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:14.957745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:14.963726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.964206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.964634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.965311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.965756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.966201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.983737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:14.984430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:14.990524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.991011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.991440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:14.992125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:14.992573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:14.992992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:15.027239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:15.035448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f9225623-4dc0-4545-8488-2d3713af89b6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082236 Sep 01 08:26:15.036317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1409/2791] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:14 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:15.055205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:15.063726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3acc4f3a-71a1-4d1c-acfe-d8375e1f1fee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084026 Sep 01 08:26:15.064288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1383/2792] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:14 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:15.146198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:15.146930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:15.153844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:15.154375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:15.154806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:15.155488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:15.155930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:15.156373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:15.218493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:15.226049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-08ff01ba-d33f-45f2-9c43-fc085982fe72 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083875 Sep 01 08:26:15.226632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1410/2793] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:15 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:15.503468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:15.504082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:15.510221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:15.510739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:15.511612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:15.512619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:15.512771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:15.513173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:15.577230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:15.577840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:15.583423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:15.584538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:15.585029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:15.585470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:15.586160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:15.586635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:15.587052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:15.591980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b207cb85-a225-4b5a-8a77-e784c19f99bb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.092927 Sep 01 08:26:15.592552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1411/2794] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:15 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:15.602935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:15.649462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:15.658130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:15.659597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:15.660692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c7d8bb25-9b4a-4c2d-8dd3-6f838c27143d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.254098 Sep 01 08:26:15.661249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1384/2795] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:15 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:16.056042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:16.056642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:16.062984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.063455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.063881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.064551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.064990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.065402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.085137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:16.085738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:16.093722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.094203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.094783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.095472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.095936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.096351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.125930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:16.133526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed4fb7d9-2d38-4b5e-95ac-e9c5e4912dba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081259 Sep 01 08:26:16.134094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1412/2796] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:16 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:16.156626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:16.164096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-443d6de2-ed17-4108-8072-eefdd7b1e465 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083123 Sep 01 08:26:16.164648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1385/2797] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:16 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:16.247262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:16.247855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:16.253748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.254218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.254673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.255342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.255784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.256198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.317320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:16.325632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44a3d9ad-7a10-4c2f-b3a3-6ffeafe2f554 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082184 Sep 01 08:26:16.326203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1413/2798] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:16 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:16.612829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:16.613527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:16.619893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.620922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.621364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.622066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.622692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.623116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.684732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:16.685337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:16.685449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:16.691449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.691915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.692338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.693012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:16.693112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-60ebdb09-557f-4b3d-8b25-3b4054c08ea9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084394 Sep 01 08:26:16.693455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:16.693891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1386/2799] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:16 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:16.694013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:16.755165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:16.763119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:16.764576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:16.765656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae27e895-5431-4821-99d6-616050603281 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086141 Sep 01 08:26:16.766204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1414/2800] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:16 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:17.155931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:17.156542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:17.162421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.162897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.163324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.164003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.164450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.164870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.184249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:17.184844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:17.190915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.191388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.191813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.192483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.192934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.193347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.225593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:17.234694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-169c9dca-2646-4efe-b913-ad5e8ce6b97e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082312 Sep 01 08:26:17.234694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1387/2801] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:17 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:17.256435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:17.264110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-74d78ead-bddc-427d-9c78-42a4d5dd615a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083607 Sep 01 08:26:17.264663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1415/2802] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:17 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:17.346193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:17.346842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:17.352803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.353277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.353713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.354421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.355488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.356011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.414294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:17.422542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-143c8e2d-402b-4b3c-b4a1-5f793cc60a6b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080102 Sep 01 08:26:17.423111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1388/2803] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:17 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:17.715830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:17.716560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:17.722765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.723251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.723684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.724383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.724838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.725297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.788602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:17.790078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:17.790773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:17.797831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-76d9a57a-7843-4820-be6e-7495088fa7a2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086891 Sep 01 08:26:17.798010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.798338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.798443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1416/2804] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:17 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:17.799549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.800311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:17.800777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:17.801207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:17.861253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:17.869118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:17.871212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:17.872293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fbffce5f-2e9d-4e46-97b9-299c7eee0e08 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086538 Sep 01 08:26:17.872840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1389/2805] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:17 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:18.254516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:18.255749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:18.262357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.262841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.263399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.263956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.264400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.264825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.284746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:18.285359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:18.291387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.291867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.292333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.293017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.293462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.293879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.327933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:18.335917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a274b8c3-2712-4b95-9ec0-0a0f0bf9774e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085471 Sep 01 08:26:18.336493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1417/2806] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:18 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:18.355918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:18.363508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4ce51b18-d630-4b19-882a-7f48b585038e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082608 Sep 01 08:26:18.364063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1390/2807] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:18 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:18.443743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:18.444366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:18.450938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.451412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.451837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.452508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.452948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.453364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.513814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:18.521354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a6d0ba53-de8a-46f8-9900-c2c30e56f81f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081426 Sep 01 08:26:18.521907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1418/2808] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:18 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:18.818639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:18.819248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:18.826211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.826714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.827149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.827845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.828292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.828714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.890525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:18.894751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:18.895351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:18.898189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d06088e2-eb71-41ef-90fd-992c0bf8426d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083318 Sep 01 08:26:18.899078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1391/2809] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:18 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:18.901206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.901750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.902461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.903144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:18.903587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:18.904004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:18.965875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:18.973808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:18.975251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:18.976412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf231369-a88a-48c5-b297-e036bd292b22 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085562 Sep 01 08:26:18.976950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1419/2810] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:18 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:19.357083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:19.357748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:19.363590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.364066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.364495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.365170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.365618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.366033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.383554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:19.384143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:19.390849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.391327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.391785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.392467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.392948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.393334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.426321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:19.434333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad88394f-faae-465c-9961-a45ee7491446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080995 Sep 01 08:26:19.434902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1392/2811] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:19 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:19.455085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:19.462882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca6d52ae-d636-47d4-8087-1b31349fb498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083099 Sep 01 08:26:19.463428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1420/2812] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:19 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:19.542447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:19.543053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:19.549660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.550137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.550590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.551268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.551714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.552128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.612438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:19.619912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d0a71206-be5e-4396-91de-62b05d207734 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081324 Sep 01 08:26:19.620982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1393/2813] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:19 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:19.920078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:19.920591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:19.926754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.927252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.927650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.928341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:19.928809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:19.929227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:19.999455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:20.000065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:20.006640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.007128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.007559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.008252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.008696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.009112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.146794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:20.158286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-54f9fa64-bc17-489a-b90c-2e20b95ff937 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.241409 Sep 01 08:26:20.158898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1421/2814] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:19 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:20.183646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:20.192404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:20.193826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:20.194961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-32afeb80-e02c-40af-a400-4aeac093450f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.199584 Sep 01 08:26:20.195629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1394/2815] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:19 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:20.459647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:20.460224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:20.466425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.466906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.467329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.468045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.468483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.468896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.484135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:20.484684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:20.490462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.490935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.491357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.492024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.492464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.492877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.532022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:20.539773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-446b64c2-017b-45d5-aaa2-bd9eef4c22c5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086046 Sep 01 08:26:20.540342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1422/2816] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:20 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:20.559116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:20.566734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b77bcce-2710-4461-960a-0b3736a59a9a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086898 Sep 01 08:26:20.567309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1395/2817] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:20 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:20.641010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:20.641636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:20.647565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.648031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.648460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.649125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:20.649564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:20.649977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:20.712052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:20.720474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ce3c927-a426-43ef-ae1a-6f39e8e3bc13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083143 Sep 01 08:26:20.721035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1423/2818] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:20 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:21.179247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:21.179843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:21.185743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.186210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.186670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.187339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.187781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.188194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.218931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:21.219528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:21.225501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.226176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.226562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.227108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.227546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.227964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.246458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:21.249575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:21.257317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e3d7e5b8-5950-4a09-a72e-a422eb7da351 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081886 Sep 01 08:26:21.257885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1396/2819] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:21 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:21.289467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:21.297482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:21.298931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:21.300000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f00afe9a-6c08-47e4-86e7-955f4febd60d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084918 Sep 01 08:26:21.300549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1424/2820] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:21 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:21.561501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:21.562089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:21.568670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.569169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.569595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.570301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.570753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.571166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.587800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:21.588397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:21.594742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.595215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.595638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.596314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.596755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.597167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.633873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:21.642325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4318d9d5-2fd1-43bc-9900-9ceaff124d56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084907 Sep 01 08:26:21.642898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1397/2821] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:21 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:21.662168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:21.670129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9a8b3a25-b081-4474-9bb0-8702287c1210 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086099 Sep 01 08:26:21.670718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1425/2822] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:21 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:21.741998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:21.742562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:21.749448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.749943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.750403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.751085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:21.751539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:21.751962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:21.812930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:21.820420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15b4a5bc-adf5-4fc2-bf16-e776f55615a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082399 Sep 01 08:26:21.820971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1398/2823] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:21 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:22.279784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:22.280436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:22.286413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.286886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.287312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.287981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.288423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.288831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.321489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:22.322090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:22.328869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.329348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.329783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.330502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.330948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.331367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.348603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:22.356263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-da696139-1768-4000-a1c9-6e617ac84fdc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.080980 Sep 01 08:26:22.356752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1426/2824] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:22 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:22.392416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:22.400333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:22.401768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:22.403034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b03f3d8-f8d1-49c4-aa67-9b5c1aa5ab8a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085391 Sep 01 08:26:22.403580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1399/2825] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:22 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:22.662853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:22.663487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:22.669988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.670685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.671117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.671795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.672241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.672659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.691227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:22.691829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:22.697599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.698079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.700841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.701589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.702050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.702503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.737020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:22.744818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b3dd574-643d-49e7-9252-481731483a63 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085811 Sep 01 08:26:22.745412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1427/2826] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:22 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:22.777313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:22.786361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c4e4b2d-f570-4e9e-bd35-5e3704663e01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.098720 Sep 01 08:26:22.787211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1400/2827] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:22 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:22.842455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:22.843057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:22.849020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.849491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.849910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.850607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:22.851055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:22.851463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:22.911118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:22.918849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3a02754a-35de-45a3-a2c3-cf35645be0a6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081028 Sep 01 08:26:22.919335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1428/2828] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:22 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:23.376668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:23.377275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:23.383252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.383733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.384168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.384868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.385344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.385765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.388454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:23.424830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:23.425429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:23.431469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.431945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.432370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.433155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.433660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.434078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.447475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:23.454842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9ea00b29-028a-4968-b14f-2f3abad6c4f2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082026 Sep 01 08:26:23.455412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1401/2829] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:23 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:23.498317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:23.506368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:23.507755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:23.508885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-592e01a4-66e8-431b-b084-3ecae6ebf805 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087796 Sep 01 08:26:23.509416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1429/2830] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:23 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:23.765904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:23.766481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:23.772317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.772789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.773215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.773884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.774357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.774775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.806510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:23.807097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:23.813679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.814153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.814612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.815295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.815735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.816152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.836368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:23.843952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bfd69759-cf1d-4dd4-a1b9-92c5a93d0e3e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081924 Sep 01 08:26:23.844556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1402/2831] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:23 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:23.877261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:23.885433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-81a32c09-363c-436d-b8bd-f8453bcd2c4f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082756 Sep 01 08:26:23.886012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1430/2832] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:23 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:23.939252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:23.939859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:23.945834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.946344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.946776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:23.947452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:23.947900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:23.948318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.011108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:24.019429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-708728a8-0cb0-40df-b658-e88c04ef1e7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083416 Sep 01 08:26:24.019947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1403/2833] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:23 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:24.476533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:24.477146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:24.487702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.488380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.488632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.489331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.489883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.490321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.532286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:24.532958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:24.539039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.539538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.539966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.540656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.541117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.541536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.576292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:24.584486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f052ad73-e0ea-4217-8aa0-91746b1cde3b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.111860 Sep 01 08:26:24.585371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1431/2834] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:24 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:24.612577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:24.625222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:24.627156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:24.629067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-384c2342-ee3e-49b6-acd4-1c5dda0e3065 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.100677 Sep 01 08:26:24.629985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1404/2835] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:24 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:24.865122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:24.865720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:24.872422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.872899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.873323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.874001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.874480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.874909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.906828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:24.908189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:24.914392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.914881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.915340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.916029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:24.916480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:24.916913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:24.935069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:24.942699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-27546adc-a80b-4f5b-952f-e6048e669372 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081436 Sep 01 08:26:24.943259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1432/2836] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:24 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:24.977654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:24.985851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f3d02f98-7772-4283-847e-82b983641b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082769 Sep 01 08:26:24.986440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1405/2837] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:24 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:25.040724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:25.041638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:25.051428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.051904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.052328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:25.053008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.053449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.053892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:25.117301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:25.125528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e17f06de-bd68-4a4a-82c7-7e1ec21ad93b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088971 Sep 01 08:26:25.126074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1433/2838] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:25 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:25.607464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:25.608064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:25.614551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.615036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.615469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:25.616154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.616596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.617010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:25.656816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:25.657559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:25.663530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.664003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.664427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:25.665104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.665570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.665988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:25.677970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:25.685984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-89bee721-ece2-4e55-be03-607b2482847c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082980 Sep 01 08:26:25.686723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1406/2839] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:25 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:25.725626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:25.734100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:25.735697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:25.736786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a5bfc771-c2ea-4f90-9ecd-1e86ff56bc63 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083840 Sep 01 08:26:25.737334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1434/2840] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:25 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:25.964167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:25.964770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:25.970613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.971084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.971514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:25.972176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:25.972618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:25.973032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.007303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:26.007876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:26.014314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.014809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.015252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.015954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.016400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.016820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.033939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:26.041570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3431f12-4a96-4242-ad8e-7a0c164557aa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081230 Sep 01 08:26:26.042139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1407/2841] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:25 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:26.080595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:26.088685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a599b09c-59c9-4b2a-831e-8aca7a26a625 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085269 Sep 01 08:26:26.089245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1435/2842] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:26 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:26.146435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:26.147032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:26.155028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.155511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.155936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.156614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.157064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.157540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.217828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:26.225423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6d1ed65a-ddd8-478a-99b2-1117898f493b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082833 Sep 01 08:26:26.225972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1408/2843] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:26 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:26.706667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:26.707441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:26.713390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.713856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.714306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.714973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.715487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.715900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.759815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:26.760416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:26.770764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.771251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.771679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.772363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:26.772805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:26.773218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:26.776581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:26.784704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a611afd-7d95-4643-9b42-4753a595e0b7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081834 Sep 01 08:26:26.785488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1436/2844] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:26 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:26.834361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:26.842891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:26.844318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:26.845404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3cbe1241-a5a8-4d46-9d7f-39d5f04d306e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089628 Sep 01 08:26:26.845955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1409/2845] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:26 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:27.063163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:27.063769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:27.065567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:27.070760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.071242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.071673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.072352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.072882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.073308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.111417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:27.112012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:27.118040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.118551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.118982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.119671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.120115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.120563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.136803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:27.145046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c4d757e6-37f2-40bb-a187-3cc190ac7551 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086212 Sep 01 08:26:27.145610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1437/2846] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:27 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:27.182827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:27.191544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-de1f6f2d-aceb-4e75-9f29-b58305477ba2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083831 Sep 01 08:26:27.192120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1410/2847] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:27 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:27.245667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:27.246279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:27.252846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.253317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.253741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.254447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.254891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.255307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.314467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:27.321904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7c7534cc-f1a5-4ee6-bc09-500464361822 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080015 Sep 01 08:26:27.322666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1438/2848] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:27 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:27.805309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:27.805873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:27.812650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.813131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.813554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.814228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.814701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.815104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.867188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:27.867788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:27.874286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.874785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.875210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.875888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:27.876158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:27.876327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:27.876747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:27.884224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-38ad1b1d-2767-4c3d-b805-3c70bc7b49f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082910 Sep 01 08:26:27.884792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1411/2849] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:27 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:27.940023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:27.948061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:27.949487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:27.951275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3358ac88-fb63-4778-8eaf-3c4ca9c8e292 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088027 Sep 01 08:26:27.951847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1439/2850] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:27 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:28.165826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:28.166412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:28.172860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.173343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.173777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.174481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.174940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.175359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.212785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:28.213385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:28.219332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.219807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.220238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.220924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.221373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.221790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.235993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:28.243760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-239726e5-b4f1-4baf-a96f-feaeea186865 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081821 Sep 01 08:26:28.244337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1412/2851] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:28 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:28.281933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:28.289458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1814f7a5-30ae-4edb-be5e-d6f53c894a19 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080436 Sep 01 08:26:28.290020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1440/2852] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:28 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:28.342057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:28.342685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:28.348557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.349039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.349472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.350148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.350616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.351039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.412336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:28.420252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f975e0d0-8709-4e22-9ffa-a3aae4bd546b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082433 Sep 01 08:26:28.420757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1413/2853] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:28 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:28.906142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:28.906768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:28.912622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.913094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.913517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.914184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.914652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.915068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.918874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:28.973454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:28.974057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:28.977939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:28.980101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.980579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.981116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.981760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:28.982206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:28.982654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:28.985616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b82c7f2-4872-4ab9-8c2f-c18398e30211 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083902 Sep 01 08:26:28.986178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1441/2854] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:28 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:29.042835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:29.050829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:29.052261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:29.053340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ce9c32a5-1b8e-4f15-9909-bfd3057521d4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083798 Sep 01 08:26:29.053894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1414/2855] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:28 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:29.265659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:29.266204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:29.272103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:29.272573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:29.273006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:29.273675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:29.274119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:29.274594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:29.311068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:29.311680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:29.317571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:29.318048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:29.318510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:29.319200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:29.319645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:29.320061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:29.334594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:29.342284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-43a346b6-1f3a-4899-a052-0c31e24b6e55 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081198 Sep 01 08:26:29.342950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1442/2856] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:29 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:29.380614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:29.388909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-594fd636-c5c6-4634-bc54-db25ffbc10e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082334 Sep 01 08:26:29.389466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1415/2857] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:29 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:29.441015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:29.441612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:29.447596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:29.448072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:29.448503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:29.449180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:29.450421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:29.450837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:29.513339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:29.520948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7449e6e4-7e31-4b48-a0c8-cfa171bc6358 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083688 Sep 01 08:26:29.521442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1443/2858] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:29 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:30.005936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:30.006569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:30.008460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:30.013717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.014208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.014656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.015338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.015782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.016198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.075831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:30.076456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:30.077006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:30.082738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.083210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.083633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.084312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.084752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.084862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57dd52dc-d878-4bac-9372-de94a3b10b2d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082747 Sep 01 08:26:30.085163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.085425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1416/2859] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:30 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:30.146249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:30.155158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:30.156564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:30.157680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a3d2aeee-a241-49e2-a5d3-a31c1284b4d8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085767 Sep 01 08:26:30.158232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1444/2860] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:30 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:30.362866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:30.363472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:30.369406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.369881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.370339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.371025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.371524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.372023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.409602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:30.410453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:30.416883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.417374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.417808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.418539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.418983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.419410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.432389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:30.434752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:30.441706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-64428b48-1e43-4bf2-bdf9-e4cef942acc4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082776 Sep 01 08:26:30.445304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1417/2861] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:30 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:30.483952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:30.491638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c800d543-df53-4ede-8dfe-61283d4fc5d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085911 Sep 01 08:26:30.492200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1445/2862] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:30 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:30.544814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:30.545427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:30.551459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.551931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.552367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.553076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:30.553603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:30.553940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:30.615004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:30.622530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0fe9ec01-2e9c-4cdc-a545-270b32a212bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084875 Sep 01 08:26:30.623090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1418/2863] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:30 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:31.106801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:31.107397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:31.113329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.113798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.114222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.114913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.115357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.115770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.178492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:31.180424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:31.181030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:31.186509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf8bce09-8320-424f-9042-d90abade0ebd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083303 Sep 01 08:26:31.187084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1446/2864] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:31 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:31.189311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.189804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.190235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.191659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.192110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.192532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.256874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:31.265574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:31.267045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:31.268135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-79b0dd2f-5f36-4858-9d6d-011d33820386 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091570 Sep 01 08:26:31.268683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1419/2865] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:31 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:31.462979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:31.463492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:31.469530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.470008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.470466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.471544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.472001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.472416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.517068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:31.517760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:31.523552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.524028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.524452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.525127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.525572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.525989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.535691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:31.543411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-94e9ccdc-4890-4483-889c-693e521e7f2c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084265 Sep 01 08:26:31.544283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1447/2866] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:31 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:31.587634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:31.595257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-81dc061e-ed6c-4e9c-8891-886943144ed8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082787 Sep 01 08:26:31.595812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1420/2867] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:31 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:31.642905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:31.643510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:31.649390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.649864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.650312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.650989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:31.651440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:31.651858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:31.711994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:31.719792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ea49c35-6d63-4841-8c32-00d3f5ce2718 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080632 Sep 01 08:26:31.720284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1448/2868] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:31 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:32.211696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:32.212467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:32.219135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.219602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.220018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.220683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.221123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.221533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.282557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:32.290322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f1885169-e3bb-41c7-83c1-735dc34efa38 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082860 Sep 01 08:26:32.290885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1421/2869] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:32 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:32.291069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:32.291681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:32.298428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.298912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.299341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.300026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.300469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.300890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.363051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:32.371277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:32.373345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:32.374479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a8331145-0bf8-41fc-8571-67816d261ba1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087266 Sep 01 08:26:32.375052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1449/2870] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:32 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:32.565063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:32.565673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:32.571791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.572268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.572697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.573496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.573821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.574237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.614691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:32.615315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:32.621260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.622360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.622881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.623584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.624035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.624455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.635842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:32.643986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1840d5ce-8272-4b2b-ba7a-cbe47ddc4061 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082740 Sep 01 08:26:32.644541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1422/2871] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:32 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:32.685587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:32.693198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5f302deb-5164-430a-9b75-119d374eacf1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082327 Sep 01 08:26:32.693754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1450/2872] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:32 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:32.740422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:32.740927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:32.748181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.748697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.749161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.749850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:32.750402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:32.750851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:32.811222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:32.818728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bc524241-6408-4ed1-a03f-b17b3043c0ae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082149 Sep 01 08:26:32.819283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1423/2873] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:32 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:33.312615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:33.313290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:33.319489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.319962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.320388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.321062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.321500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.321915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.383950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:33.391561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3579de3c-7778-4d2e-83b5-4fd7615fa081 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083600 Sep 01 08:26:33.392187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1451/2874] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:33 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:33.397490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:33.398118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:33.403994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.404466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.404888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.405557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.405995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.406439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.466331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:33.474610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:33.476037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:33.477115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46f5e6f6-2c53-4645-964d-fe02610cf92f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083465 Sep 01 08:26:33.477655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1424/2875] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:33 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:33.663515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:33.664052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:33.670656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.671125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.671547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.672214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.672661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.673072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.714007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:33.714668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:33.721322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.721799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.722228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.722933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.723379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.723798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.732491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:33.740223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3ef7980a-ea24-4b6b-899b-c25d9e77eec8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080582 Sep 01 08:26:33.740980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1452/2876] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:33 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:33.784605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:33.792603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-daadb715-dc7d-4986-a652-3ad55f2a7e85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082470 Sep 01 08:26:33.793154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1425/2877] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:33 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:33.838905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:33.839505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:33.845540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.846014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.846474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.847150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:33.847611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:33.848024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:33.910990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:33.918598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-843f1eda-7f1a-47b9-82f5-2bcd4b1f96be tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083308 Sep 01 08:26:33.919022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1453/2878] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:33 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:34.412049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:34.412702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:34.419214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.419693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.420152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.420834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.421280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.421701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.482343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:34.490848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26744c60-f84c-4b56-b469-b7479770172d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082650 Sep 01 08:26:34.491412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1426/2879] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:34 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:34.500015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:34.500630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:34.506771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.507251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.507686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.508383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.508859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.509279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.577602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:34.586049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:34.587487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:34.588564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-51a5d389-a045-4511-88f6-664c6a72f6f6 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092419 Sep 01 08:26:34.589115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1454/2880] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:34 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:34.761027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:34.761669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:34.767853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.768332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.768765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.769444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.769891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.770332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.813678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:34.814323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:34.820208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.820692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.821124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.821809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.822278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.822701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.830500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:34.838223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e39ce197-8637-4e35-b592-2bb9316814b4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081154 Sep 01 08:26:34.838814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1427/2881] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:34 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:34.886239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:34.894460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d74c56d0-4c62-4b5f-b532-2f7fb0ec5c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085368 Sep 01 08:26:34.895025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1455/2882] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:34 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:34.939270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:34.939873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:34.945776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.946247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.946703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:34.947376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:34.947826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:34.948249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.008894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:35.016576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-abcef91d-0a98-4e01-86c6-2e67efe9fe34 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081034 Sep 01 08:26:35.017073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1428/2883] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:34 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:35.511558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:35.512212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:35.518213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.518727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.519159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.519846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.520299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.520723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.580607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:35.591067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f3f6cd2-e782-4509-ab37-95b709910fc2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083129 Sep 01 08:26:35.591670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1456/2884] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:35 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:35.611943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:35.612536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:35.618389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.618860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.619286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.619952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.620394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.620806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.679991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:35.688851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:35.690291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:35.691388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4657991f-213a-4eb4-827a-43cecb94e33c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083241 Sep 01 08:26:35.692190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1429/2885] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:35 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:35.859487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:35.860118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:35.868808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.869659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.870476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.871685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.872428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.872889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.914901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:35.915511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:35.922390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.922879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.923314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.924013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:35.924463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:35.924886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:35.942140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:35.945454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:35.950503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f8438ce-edfa-4322-8341-ab646a8ad43c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.095582 Sep 01 08:26:35.951473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1457/2886] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:35 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:35.987129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:35.994660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4dad08a4-ffd0-4233-87de-e36c8482f334 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083520 Sep 01 08:26:35.995214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1430/2887] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:35 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:36.036807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:36.037406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:36.044062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.044595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.045026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:36.045692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.046135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.046582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:36.104810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:36.113140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23bf47a2-f247-4fe3-905c-855b0af6a269 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080056 Sep 01 08:26:36.113626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1458/2888] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:36 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:36.611727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:36.612366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:36.618511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.618997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.619431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:36.620119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.620578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.620995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:36.682127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:36.690182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c9ba6be-2fec-459a-ba47-9a5600774a25 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082371 Sep 01 08:26:36.690775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1431/2889] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:36 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:36.713805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:36.714512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:36.720696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.721177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.721610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:36.722312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.722767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.723189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:36.785119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:36.793019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:36.794509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:36.795617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b7f8f808-a49c-4a12-a907-8aba14846bcb tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085600 Sep 01 08:26:36.796174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1459/2890] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:36 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:36.971498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:36.972074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:36.977928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.978437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.978873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:36.979544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:36.979993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:36.980412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.015364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:37.015977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:37.021955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.022480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.022913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.023612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.024057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.024479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.040338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:37.048417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-39fde93d-4217-4134-81f0-22d016a258d3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080825 Sep 01 08:26:37.048979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1432/2891] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:36 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:37.086068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:37.094560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-662b6a89-3969-44ec-9734-abea8d9acdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083553 Sep 01 08:26:37.095127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1460/2892] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:37 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:37.133668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:37.134283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:37.140788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.141264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.141693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.142406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.142856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.143277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.203564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:37.211325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b45c869-cdc3-4c2f-a6fe-51d71d4526c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081466 Sep 01 08:26:37.211876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1433/2893] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:37 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:37.711592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:37.712281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:37.719111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.719585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.720012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.720693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.721134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.721548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.786656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:37.794681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6c3662f6-4e58-412a-bc74-7135249b15ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087341 Sep 01 08:26:37.795240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1461/2894] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:37 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:37.817412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:37.818026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:37.823967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.824453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.824876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.825740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:37.826193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:37.826647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:37.841719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:37.888357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:37.896403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:37.897838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:37.899356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5c605453-05ff-450f-9d28-31c5952ab056 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085540 Sep 01 08:26:37.899678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1434/2895] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:37 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:38.069710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:38.070366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:38.076567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.077046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.077473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.078154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.078629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.079049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.114599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:38.115186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:38.121131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.122174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.122632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.123315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.123758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.124169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.140348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:38.147965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b29117a8-b5d2-43bb-a1b6-c64f588e3efe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082171 Sep 01 08:26:38.148540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1462/2896] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:38 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:38.190312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:38.198505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ebd6430d-e88a-45be-a7be-7ff03ebb48f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087744 Sep 01 08:26:38.199064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1435/2897] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:38 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:38.232871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:38.233467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:38.239427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.239909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.240337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.241003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.241446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.241858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.303337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:38.310939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1cc261e4-d422-4211-9045-1caff70dba1e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082548 Sep 01 08:26:38.311494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1463/2898] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:38 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:38.815110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:38.815966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:38.822579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.823059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.823490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.824169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.825264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.825682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.921750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:38.922641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:38.928821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.929298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.929721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:38.930434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:38.930877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:38.931292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:39.034213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:39.042111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57c25ea1-e736-4fc7-ab1a-908e68876ea3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.230728 Sep 01 08:26:39.042714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1436/2899] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:38 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:39.061229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:39.071911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:39.073272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:39.074571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ba664d0d-96ca-4df6-9bfb-a91b2d4a4796 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.157261 Sep 01 08:26:39.075133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1464/2900] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:38 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:39.169477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:39.170082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:39.176056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:39.176534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:39.176963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:39.177645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:39.178095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:39.178615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:39.220043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:39.220654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:39.226546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:39.227028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:39.227459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:39.228144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:39.228595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:39.229048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:39.239957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:39.247620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d4059411-059c-48af-9292-4ae3ae9436fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082592 Sep 01 08:26:39.248264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1437/2901] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:39 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:39.288523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:39.296249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-86fb1c0d-2a80-42ea-988f-ecabcd146b63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080811 Sep 01 08:26:39.296803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1465/2902] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:39 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:39.331621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:39.332403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:39.338361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:39.338840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:39.339270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:39.339943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:39.340974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:39.341395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:39.402212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:39.410614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c7eca61c-a4b5-4d5f-94f6-16ade92aa264 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082777 Sep 01 08:26:39.411285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1438/2903] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:39 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:40.064469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:40.065235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:40.072488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.073254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.073512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.074200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.074703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.075114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.096992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:40.097719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:40.103638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.104099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.104527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.105203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.105646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.106725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.137060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:40.145019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b63c939f-2224-478c-957c-8cac013c3550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084493 Sep 01 08:26:40.145583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1466/2904] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:40 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:40.173015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:40.181292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:40.182735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:40.183881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5ea8b535-03f1-4d19-878a-1fc51debb4e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090727 Sep 01 08:26:40.185263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1439/2905] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:40 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:40.268538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:40.269141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:40.275130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.275612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.276041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.276717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.277160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.277629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.316854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:40.317479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:40.323987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.324641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.325145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.325905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.326463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.326961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.338193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:40.346975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7b0cf04-d0be-4663-8118-27f30c4bf038 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082270 Sep 01 08:26:40.347728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1467/2906] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:40 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:40.392032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:40.399656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d2a7a7d9-7bde-4585-89f6-075f55315ef8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086694 Sep 01 08:26:40.400210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1440/2907] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:40 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:40.430894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:40.431494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:40.437617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.438100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.438562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.439248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:40.439699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:40.440122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:40.501457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:40.509063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2ec9682-7e0e-4df4-a07f-b761dfaff0b9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081994 Sep 01 08:26:40.509618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1468/2908] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:40 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:41.165896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:41.166517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:41.172546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.173018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.173444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.174113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.174592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.175006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.206602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:41.207457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:41.213424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.213891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.214344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.215022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.215468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.215962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.235968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:41.244276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ca4b7e89-5413-4fcb-99e0-17f83f71cb86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082195 Sep 01 08:26:41.244850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1441/2909] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:41 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:41.277908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:41.286182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:41.287640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:41.288718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-19ad562b-972c-4c4e-a31f-15c514a32965 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085896 Sep 01 08:26:41.289269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1469/2910] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:41 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:41.368886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:41.369489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:41.376124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.376599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.377029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.377705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.378153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.378611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.420900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:41.421410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:41.427310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.427782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.428207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.428913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.429360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.429793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.442434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:41.451098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-052adf46-6f0c-418d-a4d8-b2350dbb859f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085791 Sep 01 08:26:41.451677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1442/2911] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:41 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:41.493580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:41.501912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf8aecca-b86d-423b-a2f1-11a4d9c66ce3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084932 Sep 01 08:26:41.502497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1470/2912] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:41 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:41.528996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:41.529663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:41.535845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.536316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.536739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.537406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:41.537847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:41.538278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:41.607849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:41.615546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e8bd0342-3c57-45fa-a504-d322b8b45e85 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090361 Sep 01 08:26:41.616103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1443/2913] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:41 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:42.265452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:42.266062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:42.271918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.272385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.272809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.273497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.273919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.274362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.310652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:42.311350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:42.317508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.317989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.318470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.319156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.319601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.320016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.334960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:42.343335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d2e6a940-0be2-4eea-8bb9-1cc075ef093c tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082232 Sep 01 08:26:42.343920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1471/2914] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:42 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:42.386733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:42.396057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:42.397496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:42.398657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6539cb6b-13c1-4c86-939a-d03c0b1544bd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091860 Sep 01 08:26:42.399251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1444/2915] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:42 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:42.473138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:42.473138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:42.479080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.479553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.479979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.481302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.481617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.482034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.522390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:42.522982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:42.529720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.530195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.530655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.531338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.531776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.532195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.544529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:42.552912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-19187930-5ed2-4ffa-831a-f61cd0ab002f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084126 Sep 01 08:26:42.553545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1472/2916] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:42 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:42.600848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:42.608834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6edf2f16-55c6-49e2-9ef6-a0f7b042c4c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090250 Sep 01 08:26:42.609410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1445/2917] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:42 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:42.637955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:42.638616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:42.644806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.645284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.645708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.646426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:42.646871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:42.647287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:42.709004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:42.716620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-32943d5b-42b8-45c1-a1fe-bab9c3cbd853 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083160 Sep 01 08:26:42.717165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1473/2918] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:42 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:43.365419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:43.366028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:43.372670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.373176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.373583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.374283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.374734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.375154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.421794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:43.422462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:43.428705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.429192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.429621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.430351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.430803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.431225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.441265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:43.449326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6fbe618e-d7db-45ea-84c7-20c7fdd9c1c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087670 Sep 01 08:26:43.450784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1446/2919] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:43 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:43.451579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:43.494944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:43.503791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:43.505224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:43.506354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-431f0bde-5a9e-495e-bf0b-94977417862b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088360 Sep 01 08:26:43.506909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1474/2920] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:43 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:43.574211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:43.575583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:43.581633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.582111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.582836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.583519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.583966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.584386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.630291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:43.630813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:43.636635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.637957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.638413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.639091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.639537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.639948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.646713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:43.655324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be8d839f-7d75-4cfd-b70c-d44ec228d362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084962 Sep 01 08:26:43.655892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1447/2921] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:43 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:43.703494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:43.711384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5141611c-0be7-4b75-b195-98d9b64116db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085062 Sep 01 08:26:43.711944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1475/2922] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:43 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:43.736869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:43.737468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:43.743336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.743808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.744239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.744904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:43.745343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:43.745756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:43.807828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:43.815394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9aa34e44-5abf-4a49-8852-94efe32714a0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082290 Sep 01 08:26:43.815959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1448/2923] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:43 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:44.471411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:44.471888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:44.477843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.478362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.478799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.479477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.479925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.480344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.530045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:44.530715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:44.536967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.537448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.537875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.538592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.539034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.539454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.542304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:44.551193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d04a155-21af-4cf3-aea0-755654e02417 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083555 Sep 01 08:26:44.551738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1476/2924] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:44 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:44.603828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:44.612787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:44.614197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:44.615314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f2d7549-be4b-4ec7-b9e2-58136a9f8d7e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089179 Sep 01 08:26:44.615870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1449/2925] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:44 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:44.676527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:44.677055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:44.683306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.684613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.684931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.685630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.686084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.686525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.733498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:44.734100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:44.740042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.740513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.740940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.741610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.742052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.742494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.745572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:44.753763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f9f4f842-bc4f-4ce8-aa96-e0c0d8eddd31 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081093 Sep 01 08:26:44.754351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1477/2926] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:44 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:44.807648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:44.815956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8c38a229-0352-4a22-ae0e-fa002e1e4eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086895 Sep 01 08:26:44.816515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1450/2927] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:44 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:44.836194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:44.836818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:44.843537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.844022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.844457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.845155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:44.845591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:44.846011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:44.907783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:44.915559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-59b2f215-acde-412a-888e-b0250867af10 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083475 Sep 01 08:26:44.916112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1478/2928] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:44 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:45.576590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:45.577221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:45.583664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.584150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.584581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.585261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.585705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.586154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.588663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:45.640899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:45.641519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:45.647545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:45.648436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.648931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.649374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.650228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.650719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.651145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.656377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ca246d7a-b0e3-404a-ba5c-b10d044cd602 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083642 Sep 01 08:26:45.657124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1451/2929] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:45 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:45.713934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:45.722865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:45.724289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:45.725383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2ee2fe1-2b77-46ed-b5dd-571d60ddb783 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091275 Sep 01 08:26:45.725930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1479/2930] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:45 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:45.774404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:45.775005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:45.781738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.782211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.782664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.783363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.783807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.784232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.836805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:45.837418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:45.845890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.846426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.846867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.847624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.847775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:45.848083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.848511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.857136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-988439d1-2aa9-4032-b44c-f0336494178c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086498 Sep 01 08:26:45.857722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1452/2931] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:45 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:45.909666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:45.917341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fabebe16-471f-44f7-9ea2-54ce3671fcb5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084321 Sep 01 08:26:45.917901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1480/2932] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:45 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:45.936381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:45.936980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:45.943004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.943494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.943915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:45.944590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:45.945056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:45.945511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.008442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:46.016782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3b0847eb-10d4-4a77-a33d-e2369dd4ceb9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084311 Sep 01 08:26:46.017343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1453/2933] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:45 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:46.677827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:46.678397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:46.684720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.685286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.685715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.686418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.686873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.687289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.747644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:46.749308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:46.749930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:46.756021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.756495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.756773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c40de73-73f7-4e21-bdd6-b81381c62b80 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082655 Sep 01 08:26:46.756974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.757572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1481/2934] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:46 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:46.757735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.758967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.759430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.826253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:46.834609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:46.836039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:46.837122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-06eb22ac-9a56-46f5-b013-2201b916b5f5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092447 Sep 01 08:26:46.837671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1454/2935] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:46 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:46.877907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:46.878540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:46.884841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.885320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.885749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.886461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.887083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.887334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.939241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:46.939879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:46.945992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.946585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.946950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:46.947188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.947962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:46.948476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:46.948959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:46.954424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-12ce0967-27c1-4504-90f8-d1167de2eaa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080230 Sep 01 08:26:46.954984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1482/2936] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:46 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:47.009251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:47.017472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dbe5a55f-297a-4226-b689-4288cb0febcb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082731 Sep 01 08:26:47.018038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1455/2937] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:46 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:47.038013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:47.038650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:47.045152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.045623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.046045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:47.046749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.047189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.047604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:47.107997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:47.115494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae71ddaf-934e-4c76-97ca-b901c63e63ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081263 Sep 01 08:26:47.116043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1483/2938] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:47 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:47.778481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:47.779128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:47.784915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.785390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.785822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:47.786525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.786975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.787395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:47.851965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:47.859718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:47.860321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-229a8468-9600-41a9-a40e-915cc3ddc584 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085885 Sep 01 08:26:47.860551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:47.865877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1456/2939] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:47 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:47.866771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.867255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.867689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:47.868392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.868838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.869256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:47.932134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:47.940846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:47.942292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:47.943378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-546d09f1-add9-4dda-8fed-2b2c6d359ac7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088074 Sep 01 08:26:47.943927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1484/2940] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:47 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:47.975207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:47.975815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:47.982206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.982796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.983232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:47.984112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:47.984364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:47.984784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.037786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:48.038422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:48.045571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.046084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:48.046227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.046644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.047335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.047787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.048207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.053932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9ff94d95-0a78-488e-81e6-2dd0f371f6ec tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082467 Sep 01 08:26:48.054530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1457/2941] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:47 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:48.108685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:48.116205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-66312d0d-a6de-4ac4-a0a0-799d2343fabf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082197 Sep 01 08:26:48.116758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1485/2942] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:48 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:48.135822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:48.136428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:48.142946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.143422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.143851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.144522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.144968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.145389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.206586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:48.214399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ab05cc0a-e6db-450f-9522-98333f850eac tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082390 Sep 01 08:26:48.214995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1458/2943] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:48 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:48.880995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:48.881652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:48.888414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.888866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.889291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.889965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.890451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.890866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.949378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:48.958425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-acb9ba12-5864-4dd3-b129-911948ee65c7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081109 Sep 01 08:26:48.959007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1486/2944] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:48 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:48.968351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:48.969140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:48.975232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.975716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.976144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:48.976869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:48.977314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:48.977735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.038436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:49.047007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:49.048450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:49.049542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-df3d620c-7038-4894-87c2-182aaddf26a9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085212 Sep 01 08:26:49.050088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1459/2945] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:48 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:49.074814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:49.075428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:49.077914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:49.082942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.083423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.083851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.084527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.084971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.085387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.137550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:49.138284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:49.144212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.144699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.145168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.145715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:49.145858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.146336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.146899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.153601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1437e1e-66db-4a16-b3f2-0ed69eb54163 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082637 Sep 01 08:26:49.154170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1487/2946] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:49 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:49.209349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:49.216957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-44f368e4-4a8a-42af-b877-efbdf0e3636b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083498 Sep 01 08:26:49.217518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1460/2947] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:49 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:49.235293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:49.235891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:49.241752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.242224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.242680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.243346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.243790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.244204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.302905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:49.311200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe5003b6-5ce6-400e-8ebe-cfb77cdcaddb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080198 Sep 01 08:26:49.311762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1488/2948] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:49 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:49.979127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:49.979709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:49.986421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.986894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.987319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:49.987994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:49.988475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:49.988890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.048780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:50.056404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70a302f4-05c7-4da6-af55-fd187f7c8960 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081069 Sep 01 08:26:50.056974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1461/2949] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:49 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:50.073536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:50.074134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:50.080564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.081040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.081472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.082441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.082895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.083313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.146937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:50.155550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:50.157029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:50.158135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-791fbd5c-95ec-426a-bbaa-eaec0a7ca7fe tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088704 Sep 01 08:26:50.158776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1489/2950] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:50 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:50.173291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:50.173920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:50.179811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.180278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.180702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.181366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.181814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.182272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.237524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:50.238136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:50.244288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.244857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.245022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:50.245294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.245981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.246490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.246975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.252593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-32dedab0-2177-4cc2-839b-1c5f43f8faba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083070 Sep 01 08:26:50.253154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1462/2951] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:50 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:50.309222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:50.316798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-364d69ea-9608-4654-ac5b-eda3a0126cf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083150 Sep 01 08:26:50.317354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1490/2952] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:50 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:50.332507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:50.333116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:50.339102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.339585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.340581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.341372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:50.341823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:50.342250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:50.406628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:50.414195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cd804570-5fe6-48ff-ab6f-813bcf61d18c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085794 Sep 01 08:26:50.414790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1463/2953] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:50 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:51.077692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:51.078427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:51.084631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.085114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.085541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.086228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.086776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.087190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.091562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:51.151024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:51.159348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ecf75357-0dbe-4efa-90d8-06c743a8c17b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086121 Sep 01 08:26:51.160290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1491/2954] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:51 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:51.181041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:51.181969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:51.188386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.188865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.189296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.189984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.190456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.191047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.256052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:51.264596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:51.266021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:51.267138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d336c8c4-fa75-40c7-8db2-e2861bffbcb8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090015 Sep 01 08:26:51.267817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1464/2955] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:51 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:26:51.272928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:51.273533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:51.280444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.280923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.281357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.282038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.282518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.282947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.337156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:51.337674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:51.344155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.344657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.345082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.345758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.346198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.346637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.349729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:51.357428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-90293cc6-404a-4242-88a8-d2b9cf694d11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088253 Sep 01 08:26:51.357994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1492/2956] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:51 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:51.406553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:51.413975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd74e5c9-492e-473a-ae6d-9af3adc62388 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080711 Sep 01 08:26:51.414562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1465/2957] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:51 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:51.435297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:51.435892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:51.441775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.442246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.442704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.443382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:51.443833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:51.444239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:51.504141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:51.511674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-080fd6b7-d040-4c14-b3f9-bdf852033541 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081076 Sep 01 08:26:51.512266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1493/2958] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:51 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:52.181010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:52.181608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:52.183518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:52.190079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.190610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.191072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.191961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.192538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.193089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.256967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:52.265756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e4c6f4b-5e5a-4daf-a929-f23cdd57fee6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088520 Sep 01 08:26:52.266345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1466/2959] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:52 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:52.288874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:52.289483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:52.295733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.296215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.296649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.297341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.297792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.298214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.359447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:52.367552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:52.368953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:52.370027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b923afd-e6c2-4aec-8da8-ae0d696551ab tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085055 Sep 01 08:26:52.370604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1494/2960] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:52 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:52.378298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:52.378989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:52.385062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.385527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.386074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.386778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.388020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.388434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.435546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:52.436071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:52.442329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.442814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.443243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.443924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.444365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.444802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.451161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:52.453439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:52.460444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-798782c0-667c-4dec-b3a8-d8d652dd41a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085975 Sep 01 08:26:52.461103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1467/2961] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:52 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:52.505879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:52.514064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d8e6338a-ba1f-42c4-bc8e-c60223d7a5c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083067 Sep 01 08:26:52.514648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1495/2962] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:52 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:52.531674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:52.532280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:52.538435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.538914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.539347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.540022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:52.540471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:52.540889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:52.607298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:52.614950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-02c50493-4736-4fd7-add1-fa58b45b6507 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087294 Sep 01 08:26:52.615508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1468/2963] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:52 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:53.287489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:53.288109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:53.295773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.296408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.296685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.297397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.297850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.298295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.361238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:53.368973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-464bd3e6-8e01-40e0-9e81-1a84c39caf2a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085532 Sep 01 08:26:53.369550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1496/2964] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:53 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:53.393413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:53.394044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:53.400071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.400546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.400972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.401652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.402093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.403108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.464491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:53.473224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:53.474676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:53.475766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2c547cdd-db57-495d-b4cc-11db498d93f8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086237 Sep 01 08:26:53.476308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1469/2965] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:53 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:53.481124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:53.481829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:53.488077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.488635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.489120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.489862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.490402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.490882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.534923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:53.535527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:53.541412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.541825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.542251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.542951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.543433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.543850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.551180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:53.559084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-31146780-f17d-42c8-8b05-804979047cd7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081815 Sep 01 08:26:53.559766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1497/2966] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:53 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:53.608689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:53.616415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf4798fc-ee01-440b-a8a1-a0bdf18124cc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085429 Sep 01 08:26:53.616965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1470/2967] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:53 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:53.640400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:53.641004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:53.650819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.651292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.651730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.652517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:53.653777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:53.654216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:53.713414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:53.721477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ee894aa-f358-4057-a6fa-088f5aa8d9d2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.089296 Sep 01 08:26:53.722059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1498/2968] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:53 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:54.390881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:54.391482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:54.397522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.398210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.398458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.399150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.399598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.400019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.463174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:54.472119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e78752df-6fb5-4ee8-940b-aea45bc52a22 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085599 Sep 01 08:26:54.473109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1471/2969] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:54 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:54.499025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:54.499626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:54.505756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.506231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.506691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.507372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.507814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.508231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.571405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:54.579871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:54.580491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:54.581111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:54.583246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:54.584889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-88d8d6e1-a400-4c31-a4aa-bbf716f76f3c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090300 Sep 01 08:26:54.585988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1499/2970] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:54 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:54.587364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.587855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.588301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.589009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.589458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.589877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.637141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:54.637765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:54.643995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.644474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.644904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.645595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.646037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.646477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.660362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:54.668725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-442275ac-a4cc-4aa8-a0c7-c96f4d3d1ee9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.092080 Sep 01 08:26:54.669530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1472/2971] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:54 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:54.710167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:54.718592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dbb0b9c8-c5c4-48fa-998d-5ac5ca1ef819 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085426 Sep 01 08:26:54.719170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1500/2972] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:54 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:54.742923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:54.743521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:54.749798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.750305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.750746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.751411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:54.751859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:54.752272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:54.811984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:54.819474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d38979d6-6ded-4cee-a89b-76f4dfecbe2b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080386 Sep 01 08:26:54.820022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1473/2973] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:54 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:55.493032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:55.493654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:55.499995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.500622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.500889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.501574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.502022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.502470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.563935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:55.577121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e64482c6-14a0-4f58-944b-8cea434fcfcb tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082443 Sep 01 08:26:55.577121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1501/2974] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:55 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:55.610488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:55.611096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:55.616950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.617421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.617848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.618544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.618984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.619397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.681260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:55.689085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:55.689690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:55.689884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:55.691340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:55.692425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a953e0fa-78c0-4f29-8ff2-bf33ae0c2fdd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086679 Sep 01 08:26:55.692976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1474/2975] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:55 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:55.695743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.696224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.696653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.697348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.697782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.698199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.740044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:55.740568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:55.746882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.747364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.747796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.748493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.748942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.749361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.759608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:55.768047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-924dccc5-edb0-4f84-9059-3e5411a9659a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082677 Sep 01 08:26:55.768972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1502/2976] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:55 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:55.812170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:55.820204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a4f3faf-679c-4938-b600-0b0dd180b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084016 Sep 01 08:26:55.820778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1475/2977] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:55 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:55.841042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:55.841647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:55.847601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.848067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.848490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.849160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:55.849602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:55.850015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:55.910057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:55.918745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-210853b6-1bca-4ff9-89d4-9dd50417f909 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082049 Sep 01 08:26:55.919306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1503/2978] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:55 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:56.594914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:56.595527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:56.601718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.602195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.602650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.603346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.603790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.604208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.668747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:56.676334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-82f49113-3352-4591-b11d-5fc8c2425646 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086824 Sep 01 08:26:56.676942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1476/2979] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:56 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:56.716804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:56.717408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:56.723272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.723744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.724172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.724844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.725289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.725704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.785214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:56.789014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:56.789616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:56.793370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:56.794845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:56.795941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-88783d4a-815d-4ddf-91d4-1ba0b75c86f2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083700 Sep 01 08:26:56.796052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.796500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1504/2980] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:56 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:56.796657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.796994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.797681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.798127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.798577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.841384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:56.842017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:56.848147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.848620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.849048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.849726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.850168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.850608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.859639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:56.867420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf42993c-f752-4a61-aa0b-f262e4c42446 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082037 Sep 01 08:26:56.868212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1477/2981] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:56 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:56.913906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:56.921678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c9ea88fb-c892-4ba0-b786-8f706fd7cf38 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084567 Sep 01 08:26:56.922243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1505/2982] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:56 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:56.939739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:56.940243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:56.947319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.947794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.948224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:56.948904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:56.949964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:56.950649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.013497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:57.021112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6baeaf2d-f404-4659-8383-a191b6c37181 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085461 Sep 01 08:26:57.021669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1478/2983] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:56 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:57.696885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:57.697494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:57.704988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.705364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.705804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.708872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.708872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.708872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.768822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:57.776382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a136302-d0f6-40e8-bcbe-6578fe5901db tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083404 Sep 01 08:26:57.776937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1506/2984] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:57 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:57.818090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:57.818712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:57.825470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.825949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.826409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.827085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.827527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.827964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.888995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:57.890249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:57.890845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:57.896712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.897097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:57.897280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.897599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.898284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.898539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:57.898732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.899146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.899616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b7c8efa-c978-4bfa-9b5f-c1c13dc3ab0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085425 Sep 01 08:26:57.900162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1479/2985] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:57 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:57.943191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:57.943799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:57.950923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.951423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.951858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.952559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:57.953010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:57.953440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:57.959966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:57.963345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:57.968952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ce3b477-62c1-4b53-a927-17ddb20314f6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083008 Sep 01 08:26:57.969527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1507/2986] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:57 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:58.018656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:58.026254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-365de901-f527-4b6e-983a-c00f9979e400 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086869 Sep 01 08:26:58.026836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1480/2987] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:57 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:58.041096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:58.041710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:58.048296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.048767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.049191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:58.049860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.050333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.050746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:58.256287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:58.264471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-568b10f6-d8bc-40d0-a7fd-ad6ecf024ddd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.227110 Sep 01 08:26:58.265048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1508/2988] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:58 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:58.795820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:58.796427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:58.802548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.803032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.803471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:58.804168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.804614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.805030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:58.889259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:58.896848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bbb59b9c-2074-490f-adae-70fffc48eea4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.104937 Sep 01 08:26:58.897402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1481/2989] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:58 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:58.921901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:58.922533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:58.928455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.928930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.929359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:58.930030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.930511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.930930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:58.989990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:58.990189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:58.990828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:58.997071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.997552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.998012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:58.998576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:58.998716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:58.999240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:58.999661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:59.000005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:59.001095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dee789aa-36c2-47f9-b50c-03d9a444580b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.083174 Sep 01 08:26:59.001822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1509/2990] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:26:58 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:26:59.047474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:59.048071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:59.053993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:59.054504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:59.054932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:59.055616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:59.056062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:59.056477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:59.063567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:59.071188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-87693798-e572-44c8-b81e-b3fc988bb9b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084709 Sep 01 08:26:59.071803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1482/2991] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:58 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:26:59.120299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:59.128494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e609e843-3f09-46ef-bf6e-b3110b118fd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085141 Sep 01 08:26:59.129058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1510/2992] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:59 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:59.284906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:59.285502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:59.291452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:59.291930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:59.292359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:59.293081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:59.293783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:59.294209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:59.353482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:59.361313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-712c26b8-b556-4ca4-902a-ce3bf2c93830 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080157 Sep 01 08:26:59.361892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1483/2993] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:59 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:26:59.917749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:26:59.918991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:26:59.925027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:59.925674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:59.925925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:59.926653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:26:59.927104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:26:59.927523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:26:59.988442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:26:59.995929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a501d3f8-067e-48d6-8a8a-5f138f9d23d9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082326 Sep 01 08:26:59.997026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1511/2994] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:26:59 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:00.024059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:00.024646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:00.030696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.031168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.031598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.032271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.032715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.033128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.047635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:00.093651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:00.094252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:00.095232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:00.100428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.100906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.101330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.102005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.102476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.102888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.103762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:00.105211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:00.107218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4592710b-0f9e-43fd-9cad-84cbd97ad01b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086928 Sep 01 08:27:00.107795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1484/2995] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:00 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:00.149253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:00.149954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:00.156638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.157199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.157644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.158360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.158842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.159262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.166592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:00.175404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f0dddab0-8e0d-4240-b804-6f7bf3b9b564 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086058 Sep 01 08:27:00.176134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1512/2996] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:00 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:00.227322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:00.235239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8fa1290b-0359-4ada-8d75-790c4f834aac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089767 Sep 01 08:27:00.235820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1485/2997] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:00 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:00.381707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:00.382331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:00.388224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.388694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.389122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.389806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:00.390244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:00.390679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:00.450358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:00.458205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0813248a-917a-4ffe-9e94-337432c470e5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080300 Sep 01 08:27:00.458789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1513/2998] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:00 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:01.016643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:01.017236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:01.023772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.024170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.024735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.025276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.025718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.026245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.089327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:01.097662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-307008bb-1734-441d-9fdd-a4c6b290dab6 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085359 Sep 01 08:27:01.098231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1486/2999] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:01 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:01.134632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:01.135855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:01.142940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.143420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.143854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.144537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.144982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.145399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.196373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:01.196977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:01.203600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.204078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.204503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.205911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.206414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.206845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.207880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:01.216711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:01.218148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:01.219268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6f1949d-e474-4e19-9502-80c2a20e1d96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092426 Sep 01 08:27:01.219822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1514/3000] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:01 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:01.256066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:01.256675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:01.263688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.264184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.264619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.265339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.265763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.266188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.268115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:01.276061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-72c495c3-e631-4ccc-a1e5-39eddfe627b8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083367 Sep 01 08:27:01.276542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1487/3001] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:01 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:01.336298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:01.345462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ecdc80e8-c683-4ad5-b975-e851cc98b4fa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.093034 Sep 01 08:27:01.346091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1515/3002] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:01 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:01.478741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:01.479403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:01.485252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.485726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.486152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.486844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:01.487286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:01.487704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:01.547036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:01.554915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-86af886f-3a9d-4b51-a0a9-9af3263e1368 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.079949 Sep 01 08:27:01.555472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1488/3003] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:01 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:02.118119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:02.118755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:02.124946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.125432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.125875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.126628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.127077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.127528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.194864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:02.203180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85a37309-7688-4c5f-86eb-8a7092c07235 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088827 Sep 01 08:27:02.203754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1516/3004] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:02 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:02.240795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:02.241443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:02.248190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.248670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.249097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.249782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.250226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.250664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.297498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:02.298302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:02.304178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.304652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.305074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.305744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.306185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.306626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.311137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:02.319394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:02.320828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:02.321919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e0c7b192-29cd-4eba-ae4a-97807eebe042 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084936 Sep 01 08:27:02.322571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1489/3005] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:02 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:02.366706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:02.367310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:02.369924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:02.373662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.374286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.374696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.375391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.375937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.376261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.378438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe8e5e28-03d2-49fe-b685-679da35ede72 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085133 Sep 01 08:27:02.379311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1517/3006] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:02 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:02.441004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:02.449944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4dc64413-8fac-4808-a42a-5cb93f366452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087027 Sep 01 08:27:02.451115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1490/3007] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:02 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:02.576582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:02.577190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:02.583515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.583988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.584444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.585117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:02.585561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:02.585977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:02.650788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:02.659075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-af9a2427-fcde-4011-a6b8-8a3cb6d48dba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086903 Sep 01 08:27:02.659628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1518/3008] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:02 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:03.224780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:03.225301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:03.231385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.232378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.232817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.233654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.234103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.234551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.297128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:03.304788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-823b58ae-3646-4667-960a-b767e23d6cc0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083919 Sep 01 08:27:03.305352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1491/3009] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:03 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:03.344254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:03.344922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:03.350778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.351258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.351685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.352365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.352809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.353223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.399807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:03.400402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:03.406652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.407713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.407713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.408226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.408669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.409083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.413832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:03.422484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:03.423894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:03.424984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b95d005-13e6-43b4-b715-2b3b75dd4fff tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.084717 Sep 01 08:27:03.431460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1519/3010] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:03 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:03.472862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:03.473319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:03.473479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:03.480088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.480495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.480921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.481061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-49a9639b-776f-4130-bb90-dcf1c01a5e21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084891 Sep 01 08:27:03.481547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1492/3011] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:03 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:03.481703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.482394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.483033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.549936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:03.557885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c861725e-8a40-473f-9119-4f9fe64a3bc6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089540 Sep 01 08:27:03.558488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1520/3012] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:03 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:03.679119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:03.679721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:03.685816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.686322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.686759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.687441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:03.687887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:03.688306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:03.747477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:03.755104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-22656c5f-95c0-4b01-964f-eb0ab56c7dc4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.079769 Sep 01 08:27:03.755655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1493/3013] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:03 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:04.325512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:04.326110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:04.332491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.332972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.333405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.334090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.334565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.334985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.399101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:04.406979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c8645e2-6f41-43d4-bf4a-eea9bbbe62b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085233 Sep 01 08:27:04.407475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1521/3014] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:04 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:04.447977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:04.448571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:04.455176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.455655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.456085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.456754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.457457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.458068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.501594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:04.502422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:04.508528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.509093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.509595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.510390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.510908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.511417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.523023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:04.532281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:04.533714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:04.534836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fbf1cf42-5db2-4450-bf8c-27fa60b5305d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090701 Sep 01 08:27:04.535389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1494/3015] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:04 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:04.578110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:04.579657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:04.582019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:04.586739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.586986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23dfb2d6-a791-4c26-b49b-bf2450c8a967 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089455 Sep 01 08:27:04.587212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.587659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1522/3016] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:04 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:04.587850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.588308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.588749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.589167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.651312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:04.659167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c38388d2-bc28-4349-9e46-203108d500e8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084222 Sep 01 08:27:04.659633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1495/3017] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:04 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:04.774915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:04.775515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:04.781706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.782178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.782639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.783313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:04.783761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:04.784180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:04.843706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:04.851241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ab50bf3-7998-4717-8179-144686b5ea39 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080132 Sep 01 08:27:04.851806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1523/3018] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:04 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:05.431609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:05.432216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:05.438677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.439164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.439602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.440296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.440741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.441168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.511739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:05.520179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8acdc4b-33a5-472b-846b-00c56b207149 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095495 Sep 01 08:27:05.520758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1496/3019] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:05 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:05.557215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:05.557823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:05.565150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.565756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.566306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.567194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.567734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.568244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.587342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:05.608129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:05.608736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:05.614760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.615244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.615678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.616376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.616828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.617249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.636792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:05.644749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:05.646163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:05.647358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d00479b2-788b-4d93-946e-695c3708bd69 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094085 Sep 01 08:27:05.647973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1524/3020] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:05 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:05.678979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:05.679884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:05.680497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:05.687011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.687299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad35abae-3f91-4051-b009-827670793ba6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083417 Sep 01 08:27:05.687433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.688069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.688203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1497/3021] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:05 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:05.688500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.688939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.689354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.752647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:05.760278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b002ef60-c969-49d5-8a8a-8c5893cced69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084043 Sep 01 08:27:05.760839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1525/3022] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:05 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:05.873024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:05.873660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:05.879756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.880248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.880673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.881352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:05.881788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:05.882249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:05.942784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:05.950208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-38e2735e-7ead-46ce-9afe-123dde022ee0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081115 Sep 01 08:27:05.950842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1498/3023] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:05 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:06.541144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:06.542024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:06.548548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.549033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.549466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.550159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.550658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.551160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.621580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:06.630040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e1e7b20-6745-402e-8783-73e70bf464df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.093032 Sep 01 08:27:06.630651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1526/3024] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:06 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:06.670596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:06.671189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:06.677966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.678706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.679137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.679817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.680261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.680679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.708076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:06.708670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:06.714612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.715086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.715512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.716249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.716692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.717105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.740930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:06.749900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:06.751351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:06.752438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28e9f738-fe48-4e01-bf23-1b85e0ec6116 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085832 Sep 01 08:27:06.752987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1499/3025] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:06 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:06.776928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:06.780930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:06.781526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:06.784617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52e30280-9d8e-487e-b6be-ed276436fc46 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080634 Sep 01 08:27:06.785188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1527/3026] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:06 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:06.787603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.788079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.788505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.789181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.789617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.790027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.851538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:06.859556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cc892b16-8073-431c-9811-859a0e5290c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082574 Sep 01 08:27:06.860123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1500/3027] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:06 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:06.971191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:06.971726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:06.977604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.978074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.978533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:06.979203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:06.979645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:06.980059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.041758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:07.050082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-041594b0-df12-4239-8e29-74dc18448b5d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082892 Sep 01 08:27:07.050670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1528/3028] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:06 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:07.651483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:07.652086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:07.658701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.659179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.659612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.660294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.660746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.661166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.663821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:07.725089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:07.733483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-534dfb31-62fc-461f-9514-bcb9af237e81 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085704 Sep 01 08:27:07.734074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1501/3029] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:07 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:07.775897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:07.776505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:07.782860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.783341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.783777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.784461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.784909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.785335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.805475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:07.806076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:07.813281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.813823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.814326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.815006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.815552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.816038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.847214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:07.855800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:07.857721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:07.858850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03d6784d-3cbf-482d-8513-b345db890766 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087043 Sep 01 08:27:07.859416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1529/3030] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:07 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:07.878352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:07.880508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:07.881107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:07.886859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a44973b-a36c-4d2f-afe1-7ab9bc8d13fd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085677 Sep 01 08:27:07.887345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.887472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1502/3031] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:07 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:07.888068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.888582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.889284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:07.889767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:07.890490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:07.954290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:07.962354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e6a6f1f4-1aa0-4ffb-a079-64e1852673f2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085576 Sep 01 08:27:07.962920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1530/3032] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:07 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:08.071363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:08.072001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:08.077996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.078507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.078939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.079615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.080067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.080482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.140682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:08.148249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-777bf94f-a247-4fc2-a7b1-e362bb9ba753 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080661 Sep 01 08:27:08.148811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1503/3033] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:08 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:08.754306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:08.754953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:08.760954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.761438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.761869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.762591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.763039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.764003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.825878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:08.835170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b846584-8662-4be7-ad7f-ae4bb8fb4bd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084739 Sep 01 08:27:08.835761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1531/3034] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:08 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:08.881106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:08.881708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:08.889254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.889739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.890174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.891015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.891458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.891878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.907492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:08.908869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:08.914855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.915338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.915768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.916461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.917229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.917996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.956986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:08.965518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:08.967616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:08.968614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fad475e6-2335-4c39-b230-b8a6088f8e0d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091467 Sep 01 08:27:08.969170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1504/3035] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:08 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:08.983302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:08.983917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:08.989998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.990515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.990945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.991627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:08.992069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:08.992604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:08.995465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:09.003363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ccf69246-fc4a-4ae3-88a5-7096544b393c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.099671 Sep 01 08:27:09.003933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1532/3036] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:08 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:09.056953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:09.064714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70991c1e-6211-4ef6-a182-9765b5c9d0d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085999 Sep 01 08:27:09.065276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1505/3037] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:08 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:09.168998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:09.169629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:09.176177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:09.176648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:09.177073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:09.177739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:09.178179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:09.178618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:09.237467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:09.245016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2bd37639-bf66-402f-856b-5dc2563592c4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.079877 Sep 01 08:27:09.245563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1533/3038] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:09 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:09.856963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:09.857788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:09.864547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:09.865036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:09.865476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:09.866169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:09.866642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:09.867062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:09.931554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:09.940247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6af80a6e-4728-4012-bcb0-895101587cec tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086993 Sep 01 08:27:09.940816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1506/3039] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:09 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:09.991974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:09.992603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:09.999351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:09.999824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.000289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.000969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.001417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.001829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.024315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:10.025381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:10.031086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.031565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.031998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.032705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.033138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.033556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.065381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:10.075540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:10.077452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:10.078593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9122cdf7-a29d-4611-90da-9219e6ce9df0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090687 Sep 01 08:27:10.079172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1534/3040] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:09 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:10.084772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:10.085377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:10.091927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.092566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.092977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.093681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.094134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.094593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.097108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:10.104740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1f834c34-9158-440f-b8b7-d0656317087e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084287 Sep 01 08:27:10.105324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1507/3041] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:10 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:10.157469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:10.165341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8e95750f-ff67-47e6-bd41-9e09a7807114 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084376 Sep 01 08:27:10.165911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1535/3042] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:10 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:10.269572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:10.270190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:10.276760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.277241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.277679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.278390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.278842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.279971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.345705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:10.353533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c0359724-4a01-4bd2-a36b-e801e08ca7e9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087807 Sep 01 08:27:10.354094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1508/3043] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:10 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:10.961267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:10.961867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:10.968440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.968916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.969342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:10.970025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:10.970511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:10.970950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.035680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:11.043579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c04156a9-7d75-4b1a-8bde-62b9b14fecf3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086336 Sep 01 08:27:11.044154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1536/3044] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:10 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:11.101167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:11.101762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:11.108513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.108996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.109424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.110118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.110590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.111008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.126581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:11.127384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:11.129216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:11.134685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.135092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.135524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.136221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.136672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.137231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.174862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:11.183690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:11.185121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:11.186659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-69cae698-a292-4c7f-bad6-3c547cd33f85 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089366 Sep 01 08:27:11.187218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1509/3045] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:11 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:11.191731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:11.192396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:11.198482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.198826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.199256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.199940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.200394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.200805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.201868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:11.209994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6986409f-898c-4f49-9895-708c88a86822 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087285 Sep 01 08:27:11.210609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1537/3046] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:11 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:11.264182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:11.271805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a1ca76d-8d28-4917-9f0b-5dd9f870a9eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083618 Sep 01 08:27:11.272380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1510/3047] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:11 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:11.373203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:11.373799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:11.379666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.380136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.380560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.381229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:11.381671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:11.382085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:11.441386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:11.449123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-11cb23a6-aeee-4902-92ff-5a067b311896 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.079664 Sep 01 08:27:11.449693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1538/3048] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:11 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:12.064600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:12.065197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:12.071196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.071671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.072109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.072785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.073230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.073647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.137617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:12.146038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fc2e870d-7953-42f8-916f-05aad7657099 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085292 Sep 01 08:27:12.146640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1511/3049] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:12 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:12.210221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:12.210893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:12.217028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.217559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.218625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.219413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.219925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.220342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.230999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:12.231599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:12.238309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.238791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.239223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.239905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.240358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.240777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.284716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:12.293296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:12.294747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:12.295924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d616ff20-e772-4852-8c9f-bebd24254a67 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090266 Sep 01 08:27:12.296771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1539/3050] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:12 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:12.302977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:12.305715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:12.313882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:12.315870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.316237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.316666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.317369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.317813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.318229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.321737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-feb4df6d-3dcb-4813-8198-a5f0a1c91362 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094417 Sep 01 08:27:12.322502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1512/3051] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:12 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:12.383018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:12.391486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b1df305d-2216-4b5a-b8e7-a7a2c837a5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.093808 Sep 01 08:27:12.392060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1540/3052] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:12 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:12.471005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:12.472127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:12.477642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.478116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.478587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.479271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:12.479713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:12.480128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:12.542504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:12.550230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e560ea2f-1182-4dcc-a587-2c691c98aaeb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083935 Sep 01 08:27:12.550893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1513/3053] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:12 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:13.168196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:13.168801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:13.175371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.175845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.176270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.176952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.177397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.177808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.181878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:13.241867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:13.250325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d4d9d6f-7a58-4ceb-b3d1-0e51e7e75634 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085853 Sep 01 08:27:13.250892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1541/3054] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:13 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:13.325275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:13.325885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:13.332034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.332773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.333208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.333889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.334361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.334777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.343999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:13.344625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:13.350501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.350975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.351403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.352077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.352518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.352929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.403896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:13.412923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:13.414374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:13.415479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2e5e584a-06ff-4933-ad31-c0a4555cdc96 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094225 Sep 01 08:27:13.416061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1514/3055] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:13 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:13.420560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:13.421669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:13.425195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:13.427956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.428434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.429338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.429534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.429979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.430428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.433764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4a13867-4f28-4228-8bc6-ba08fc271c9a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094033 Sep 01 08:27:13.434581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1542/3056] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:13 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:13.494855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:13.502776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d597c36-0c22-41e3-b5cd-de31ef19b217 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085680 Sep 01 08:27:13.503351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1515/3057] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:13 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:13.570703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:13.571344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:13.577685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.578198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.578635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.579327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:13.579775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:13.580225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:13.642990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:13.650629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a73bc5f9-5c3d-4978-855a-ae776c017480 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083731 Sep 01 08:27:13.651410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1543/3058] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:13 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:14.271392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:14.271995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:14.273887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:14.279204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.279696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.280311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.280971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.281429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.281850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.343839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:14.351762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-049f4b59-2f82-45bb-8ec8-b213ae519ce7 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084129 Sep 01 08:27:14.352339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1516/3059] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:14 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:14.438888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:14.439431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:14.445630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.446086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.446542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.447219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.447670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.448080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.454010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:14.454668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:14.460797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.461271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.461726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.462432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.462875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.463290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.521383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:14.530041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:14.532029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:14.533164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6ff1ee3c-6a37-4514-9688-936d615cfe8b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.098873 Sep 01 08:27:14.533729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1544/3060] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:14 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:14.537772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:14.540168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:14.546668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:14.547701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:14.548086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91cb6b83-42b5-46a8-89f4-07660c9f4d8a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.097671 Sep 01 08:27:14.548922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1517/3061] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:14 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:14.554347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.554916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.555356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.556053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.556502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.556923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.623068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:14.631556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61f57161-7d8c-4993-83cc-ec8adcd31a65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.096844 Sep 01 08:27:14.632119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1545/3062] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:14 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:14.672784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:14.673383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:14.679255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.679726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.680150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.680821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:14.681258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:14.681678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:14.741591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:14.749680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0663c32d-f173-4a95-9cab-833737eb30d7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080844 Sep 01 08:27:14.750232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1518/3063] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:14 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:15.372744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:15.373340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:15.379264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.379744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.380170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.380839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.381576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.381999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.444172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:15.454999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7d3a8b6d-daaa-474c-9d00-7611bb5dae5e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085271 Sep 01 08:27:15.455122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1546/3064] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:15 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:15.556363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:15.556973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:15.563827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.564317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.564746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.565433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.565882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.566335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.568702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:15.569447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:15.575831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.576336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.576772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.578242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.578868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.579301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.638205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:15.647708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:15.649545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:15.650707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9fda7b8f-bfb0-4368-925c-04a21f6ba81c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.098374 Sep 01 08:27:15.651282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1519/3065] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:15 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:15.656269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:15.656885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:15.661960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:15.663510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.663994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.664431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.665512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.665642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.665975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.669737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-166f13fb-3101-4a7b-b08e-6a833e914e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.104773 Sep 01 08:27:15.670335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1547/3066] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:15 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:15.732353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:15.740116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1b92c2d-a83c-430a-a4eb-a5c9fa93b418 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087899 Sep 01 08:27:15.740672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1520/3067] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:15 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:15.770379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:15.770997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:15.776880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.777349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.777779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.778486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:15.778931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:15.779348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:15.838794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:15.846444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a68a9770-fc1c-4540-9638-a840eabe9fbe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.079795 Sep 01 08:27:15.847014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1548/3068] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:15 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:16.476796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:16.477398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:16.483997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.484479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.484906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.485583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.486024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.486463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.549280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:16.557948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5e37a9dd-cb3d-4873-ba58-6c2d26a2157e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084842 Sep 01 08:27:16.558666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1521/3069] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:16 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:16.672585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:16.673175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:16.679139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.679616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.680044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.680733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.681161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.681578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.690104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:16.690653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:16.696864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.697348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.697774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.698487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.698932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.699346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.761851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:16.771052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:16.772486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:16.773677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f312155f-f966-4022-a950-1e81a2464e6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.105208 Sep 01 08:27:16.774236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1549/3070] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:16 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:16.778834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:16.779443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:16.785347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:16.786159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.786676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.787323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.788186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.788866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.789456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.793805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-afe5d5f9-df72-4855-b007-a1e771aa9c6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.107609 Sep 01 08:27:16.794412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1522/3071] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:16 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:16.853916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:16.861419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-453f09ab-ae3b-4606-9b2e-507134cad796 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086203 Sep 01 08:27:16.861976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1550/3072] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:16 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:16.867112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:16.867721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:16.873495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.874188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.874849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.875535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:16.875990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:16.876413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:16.936358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:16.944243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4e926e11-6e39-4548-8505-84171c0c9ce5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080792 Sep 01 08:27:16.944719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1523/3073] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:16 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:17.579006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:17.579637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:17.585859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.586374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.586807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.587490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.587938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.588356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.649416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:17.658670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5881b5c2-1f2a-4e8d-8cd9-a3ae498b26f4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083457 Sep 01 08:27:17.659242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1551/3074] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:17 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:17.797493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:17.798100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:17.804044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.804520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.804950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.805628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.806079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.806623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.813504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:17.814109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:17.820202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.820745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.821215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.821849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.822323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.822743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.870879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:17.881870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:17.883511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:17.884923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8cde09f2-be45-4c1b-bde2-0818886640b1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091965 Sep 01 08:27:17.885623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1524/3075] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:17 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:17.892845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:17.892845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:17.898656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.899146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.899683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.900276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.900728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.901149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.903993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:17.912571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c736c95a-67b8-48f6-8d8c-d784ac0311ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.102744 Sep 01 08:27:17.913253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1552/3076] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:17 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:17.964299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:17.964926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:17.968726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:17.971423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.971904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.972362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.973042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:17.973493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:17.973915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:17.976301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0fca4260-2e48-4d5b-889e-58001e77ac10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089334 Sep 01 08:27:17.976855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1525/3077] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:17 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:18.033283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:18.040872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd453e86-b69b-4076-abfa-096814c8b216 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.080368 Sep 01 08:27:18.041431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1553/3078] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:17 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:18.680194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:18.680792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:18.687237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:18.687710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:18.688132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:18.688810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:18.689248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:18.689659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:18.749985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:18.757682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-97d46c87-727c-4ac1-a017-8c5d75532611 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081350 Sep 01 08:27:18.758276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1526/3079] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:18 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:18.909211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:18.909813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:18.916074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:18.916549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:18.916978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:18.917650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:18.918097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:18.918539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:18.933063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:18.933692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:18.939780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:18.940258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:18.940685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:18.941373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:18.941823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:18.942235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:18.983833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:18.992399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:18.993843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:18.995011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0955452f-6a71-45fa-aeba-80df5abda83d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090338 Sep 01 08:27:18.995569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1554/3080] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:18 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:19.000169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:19.000700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:19.006954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:19.007439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:19.007871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:19.008563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:19.009010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:19.009996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:19.010890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:19.019447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4358715f-3cca-4d22-b75f-13c23777ff30 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090105 Sep 01 08:27:19.020018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1527/3081] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:18 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:19.061216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:19.061874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:19.068100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:19.068589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:19.069026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:19.069713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:19.070169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:19.070630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:19.071278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:19.079642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5c85fc9-9438-43b4-bc05-569557ee2428 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083076 Sep 01 08:27:19.080220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1555/3082] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:18 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:19.132318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:19.140478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a283f231-6503-4b95-a0d9-01970b056451 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083052 Sep 01 08:27:19.141191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1528/3083] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:19 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:19.779005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:19.779528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:19.785473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:19.785953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:19.786453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:19.787135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:19.787592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:19.788016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:19.848766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:19.856664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-064fcb99-b07f-4c01-b459-2efa9fdf17ca tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081635 Sep 01 08:27:19.857231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1556/3084] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:19 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:20.016938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:20.017537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:20.023400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.023868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.024295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.024996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.025438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.025866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.041010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:20.041568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:20.048937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.049429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.049858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.050573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.051028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.051457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.096623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:20.105910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:20.107376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:20.109105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2eacaa17-48b6-4455-8659-4faaa4874cd0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095492 Sep 01 08:27:20.109710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1529/3085] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:20 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:20.114446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:20.115028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:20.121384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.121866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.122315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.123016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.123468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.123935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.124797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:20.128947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:20.135071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b109e78-07c0-49d7-8045-e98d03663550 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.097888 Sep 01 08:27:20.135643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1557/3086] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:20 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:20.161232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:20.161836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:20.168060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.168539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.168967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.169649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.170098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.170553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.185632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:20.193489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6d0c2568-bd3a-4bcc-b57a-c6ca4ba805e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082760 Sep 01 08:27:20.194052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1530/3087] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:20 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:20.231544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:20.239897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-adf8fd81-8625-4072-8e4c-8933e0362fb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082385 Sep 01 08:27:20.240450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1558/3088] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:20 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:20.877958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:20.878585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:20.884811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.885358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.885930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.886876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:20.887322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:20.887737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:20.951657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:20.960243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f280a1a-ee48-4cab-8021-079667d27b95 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086551 Sep 01 08:27:20.960820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1531/3089] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:20 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:21.131544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:21.132082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:21.138435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.139013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.140066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.140834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.141285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.141811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.157405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:21.158109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:21.164248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.164731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.165165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.165856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.166332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.214431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:21.223476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:21.224911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:21.226010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc30a501-99c0-4706-bab2-0d66bc59c6fd tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.098472 Sep 01 08:27:21.226613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1559/3090] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:21 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:21.231131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:21.231746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:21.235596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:21.241478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.241965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.242446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.243191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.243700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.244147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.247255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57be36b6-c502-4d00-8b24-f3665a2c78d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094310 Sep 01 08:27:21.247839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1532/3091] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:21 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:21.264278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:21.265417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:21.271305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.271782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.272219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.272901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.273350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.273772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.305311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:21.313035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3976e088-2a85-4362-b538-e552e2053498 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085442 Sep 01 08:27:21.313826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1560/3092] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:21 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:21.338185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:21.346562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4159c953-f2ae-4c0e-a82b-6484fd7ce22f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085947 Sep 01 08:27:21.347129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1533/3093] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:21 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:21.980396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:21.980981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:21.987763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.988265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.988696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:21.989371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:21.989820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:21.990240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.052407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:22.060347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-284a3ee0-3415-4556-8e59-970a9ae45449 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083706 Sep 01 08:27:22.060908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1561/3094] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:21 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:22.249976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:22.250578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:22.256859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.257453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.257950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.258737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.259206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.259621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.268692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:22.269415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:22.276030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.276273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:22.276822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.277432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.278588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.279290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.279686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.333716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:22.342393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:22.344065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:22.345177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-49a6c063-cac8-466c-9699-75345a0a106b tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.100060 Sep 01 08:27:22.350738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1534/3095] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:22 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:22.352584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:22.353191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:22.353376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:22.361553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.361769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-867c8510-281d-44ab-98c8-decf592d8252 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.097050 Sep 01 08:27:22.361884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.362317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.362480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1562/3096] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:22 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:22.363086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.363541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.363963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.376131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:22.376833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:22.382997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.383482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.383912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.384621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:22.385069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:22.385510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:22.428680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:22.437017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0e08ba1-a2b8-48b3-bbd4-c280902eeaee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089996 Sep 01 08:27:22.438252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1535/3097] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:22 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:22.586304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:22.594542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e73abb1c-3410-4858-8451-83aae5405dad tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.222820 Sep 01 08:27:22.595082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1563/3098] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:22 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:23.081626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:23.082538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:23.088442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.088916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.089344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.090011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.090490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.090905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.151016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:23.158891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f9bee0a-b9cc-43a3-bc8a-77df755bcefd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081722 Sep 01 08:27:23.159457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1536/3099] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:23 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:23.367531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:23.368125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:23.375373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.375887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.376397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.377040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.377497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.377921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.381611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:23.382220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:23.388032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.388519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.388948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.390214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.390690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.391112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.475435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:23.477803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:23.484904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:23.486355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:23.486874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c1ec3dbc-913c-4b5d-95ba-53ae6e14b721 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.109010 Sep 01 08:27:23.487441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b13deec6-7c6e-4b42-ae36-a8ed3bc36620 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.123793 Sep 01 08:27:23.487551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1537/3100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:23 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:23.488980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1564/3101] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:23 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:23.492426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:23.493112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:23.500105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.500754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.501258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.501978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.502477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.502905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.563926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:23.572620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-656e62b4-5927-4bae-9f8b-6191bb1d1da4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083909 Sep 01 08:27:23.573223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1538/3102] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:23 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:23.615317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:23.615910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:23.621998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.622449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.622880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.623574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:23.624095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:23.624442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:23.688521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:23.697963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9beb3c63-35c7-44c6-bdbc-243941e3435d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086773 Sep 01 08:27:23.698566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1565/3103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:23 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:24.182486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:24.183225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:24.190138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.190654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.191172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.191774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.192219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.192636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.444502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:24.454143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb0b8bb7-2081-44cb-808f-91e09e341392 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.277243 Sep 01 08:27:24.462383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1539/3104] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:24 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:24.508470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:24.509067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:24.509178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:24.509734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:24.516615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.516920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.517091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.517410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.517527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.517842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.518190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.518592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.518730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.519044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.519163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.519462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.602895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:24.604780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:24.611053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fc04937e-05f7-4aa4-bd36-81f0ba496637 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.106340 Sep 01 08:27:24.611623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1566/3105] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:24 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:24.613049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:24.614739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:24.615846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-af739c12-0df7-4dae-9daa-d24faf7c9997 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.110514 Sep 01 08:27:24.615981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:24.616382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1540/3106] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:24 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:24.616561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:24.622381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.622843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.623275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.624497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.625090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.625499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.696951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:24.705193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47f3d026-575d-43fb-afd2-c5da36d96086 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.092596 Sep 01 08:27:24.705751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1567/3107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:24 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:24.720251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:24.721120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:24.727192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.727666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.728079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.728760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:24.729199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:24.729611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:24.793314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:24.801027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f093c2d5-b4dd-4aef-a632-642405918295 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084528 Sep 01 08:27:24.801578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1541/3108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:24 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:25.475672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:25.476259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:25.482231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.482721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.483160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.483851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.484357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.484716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.546940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:25.554665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1be29539-dd19-4073-b583-62406289c9b8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082752 Sep 01 08:27:25.555225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1568/3109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:25 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:25.632321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:25.633108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:25.637769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:25.638283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:25.639201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.640297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.640722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.641405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.641848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.642272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.645032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.645517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.645950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.646665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.647123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.647527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.726971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:25.728802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:25.735293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-714c371d-2736-4bc9-ab9e-f0234cf9df97 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.106810 Sep 01 08:27:25.735857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1542/3110] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:25 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:25.740285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:25.740532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:25.740975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:25.742353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:25.743854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-04ccca37-353e-4fa4-b4fb-50c62ff13e33 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.109989 Sep 01 08:27:25.744637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1569/3111] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:25 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:25.746870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.747346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.747774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.748447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.749566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.750009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.812384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:25.820222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28c27687-8334-433e-bbed-6240614da97d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083332 Sep 01 08:27:25.820766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1543/3112] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:25 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:25.821728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:25.822384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:25.828398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.834312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.834312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.834312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:25.834312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:25.834782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:25.892646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:25.901027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ab40b79e-da91-4a80-9b39-6dc258f100f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083079 Sep 01 08:27:25.902638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1570/3113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:25 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:26.576034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:26.576636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:26.583294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.583779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.584210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.584895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.585339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.585755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.646912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:26.654630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c902da27-1c15-4295-af8a-0dd4225cbbbd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082430 Sep 01 08:27:26.655246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1544/3114] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:26 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:26.756184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:26.756777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:26.762723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.763196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.763626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.764301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.764910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.765329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.767561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:26.768194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:26.774383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.775041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.775476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.776162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.776606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.777018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.839222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:26.846911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6c6a1d98-0d55-44df-926d-7f17cf0424ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094578 Sep 01 08:27:26.847533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1571/3115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:26 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:26.851951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:26.852541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:26.858091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:26.861630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.862118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.862597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.863299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.863750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.864171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.866131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:26.867581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:26.868673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04b6c210-acf1-45fd-a192-53ae3c331d01 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.105252 Sep 01 08:27:26.869211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1545/3116] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:26 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:26.924132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:26.924738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:26.930811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.931285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.931710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.932399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:26.932838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:26.933255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:26.934208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:26.943178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52dd1275-2381-46e1-9216-da92d64e482d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094605 Sep 01 08:27:26.943863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1572/3117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:26 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:26.994755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:27.002837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80ffc932-cd80-4069-b39a-3cbbd4d3e902 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082625 Sep 01 08:27:27.003384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1546/3118] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:26 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:27.676212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:27.676828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:27.684305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.684795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.685468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.686505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.687318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.687755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.753857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:27.761746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c178ebe5-d1f4-474c-81ef-8e1952018178 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089409 Sep 01 08:27:27.762418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1573/3119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:27 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:27.868431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:27.869131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:27.876259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.876836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.877215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.877914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.878404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.878830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.892050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:27.892644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:27.899338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.899819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.900249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.901076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.901529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.901948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.920004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:27.943838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:27.951694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8e12d25-5bb9-44d3-84af-dd5278563e86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087389 Sep 01 08:27:27.952706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1547/3120] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:27 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:27.964552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:27.965215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:27.969713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:27.971485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.971968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.972392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.973074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:27.973513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:27.973925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:27.977686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:27.979143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:27.980224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1d5c8e53-75ff-40cf-8db6-a21bd2d55c87 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092290 Sep 01 08:27:27.980776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1574/3121] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:27 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:28.024483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:28.025004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:28.031559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:28.032048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:28.032485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:28.033186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:28.033640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:28.034066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:28.039228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:28.047613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-056b7741-d339-44c7-b0d2-ed7833192ed7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086525 Sep 01 08:27:28.048192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1548/3122] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:27 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:28.097772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:28.105335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ad139db-b4a5-4efe-9330-37e47226c613 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084765 Sep 01 08:27:28.106232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1575/3123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:28 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:28.782967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:28.783601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:28.789662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:28.790144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:28.790610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:28.791303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:28.791754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:28.792165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:28.856485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:28.864873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d74b515b-82cd-4d39-8897-d037ed115e34 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085877 Sep 01 08:27:28.865467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1549/3124] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:28 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:28.972952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:28.973542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:28.979697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:28.980179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:28.980614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:28.981308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:28.981754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:28.982172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.005082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:29.005673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:29.011869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.012350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.013744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.014684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.015176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.015628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.043782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:29.052297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02f30ff8-e59d-4949-93ad-dc1fc6010d32 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083169 Sep 01 08:27:29.052869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1576/3125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:28 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:29.076443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:29.084792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:29.086212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:29.087321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4908d544-62bc-4869-825d-1f5ca47546f1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086138 Sep 01 08:27:29.087876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1550/3126] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:29 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:29.126962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:29.127582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:29.135455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.135948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.136391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.137098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.137554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.137982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.141810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:29.186050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:29.186855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:29.193068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.193548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.193982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.194762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.195214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.195637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.201758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:29.209791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-01dc0af0-0165-44c2-aef5-52743fe82246 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087496 Sep 01 08:27:29.210374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1551/3127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:29 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:29.258930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:29.266740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-46d2cb13-9ca6-4407-8ea5-d4e111748960 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.202287 Sep 01 08:27:29.267296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1577/3128] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:29 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:29.887856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:29.888468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:29.895327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.895806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.896237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.896923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:29.897369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:29.897786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:29.959440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:29.967187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-59bd1f1a-9f29-4d0b-b5d8-a15fb53caa51 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084770 Sep 01 08:27:29.968168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1552/3129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:29 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:30.073256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:30.073887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:30.081426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.081901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.082625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.083305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.083748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.084161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.111648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:30.112243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:30.118189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.118695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.119125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.119802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.120242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.120654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.146010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:30.153512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d47b6fd9-4345-4158-9771-bdfb222eca88 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084290 Sep 01 08:27:30.154108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1578/3130] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:30 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:30.181131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:30.189361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:30.190799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:30.191870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eee3dc1d-993d-4281-8a95-8255b8730f6f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.085521 Sep 01 08:27:30.192412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1553/3131] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:30 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:30.230424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:30.231068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:30.237548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.238070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.238529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.239232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.239681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.240106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.287377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:30.287983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:30.293952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.294489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.294918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.295607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.296068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.296480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.304622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:30.312359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e37f922b-5b65-4a92-b947-4cdf565a3e0b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085744 Sep 01 08:27:30.312987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1579/3132] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:30 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:30.356400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:30.363930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8876ef16-7746-45f7-8b04-7269f555908e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080428 Sep 01 08:27:30.364488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1554/3133] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:30 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:30.988812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:30.989416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:30.995590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.996080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.996508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:30.997200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:30.997655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:30.998091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.060057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:31.068629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85f52250-5ed8-42de-833a-0702fd0dcca9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083578 Sep 01 08:27:31.069202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1580/3134] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:30 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:31.175073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:31.175681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:31.181764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.182243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.182702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.183406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.183837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.184253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.214635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:31.215337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:31.221398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.221946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.222408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.223083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.223529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.223951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.244759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:31.252863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-03d14efd-099e-4311-8916-9b8025ee93db tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082358 Sep 01 08:27:31.253429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1555/3135] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:31 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:31.287321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:31.295283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:31.297365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:31.298480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7dd4629-f543-4e85-acc2-7c87ae45fff9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087888 Sep 01 08:27:31.299035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1581/3136] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:31 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:31.333237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:31.333844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:31.339998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.340481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.340911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.341599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.342044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.342533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.384446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:31.385051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:31.392056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.392530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.392959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.393643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:31.394085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:31.394535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:31.403343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:31.411647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19cfd6bf-443d-429d-b62d-3f656dd32f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082643 Sep 01 08:27:31.412218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1556/3137] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:31 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:31.454823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:31.462576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61a1d939-0a19-4796-8eef-b16b6fbd1372 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081952 Sep 01 08:27:31.463125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1582/3138] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:31 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:32.089388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:32.089986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:32.096167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.096650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.097075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.097768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.098215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.098656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.167246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:32.175653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ab0128b9-8ac2-4e8d-bc72-b63d6d26403e tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090097 Sep 01 08:27:32.176280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1557/3139] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:32 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:32.273380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:32.273995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:32.280907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.281362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.281791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.282625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.283072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.283482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.320762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:32.321458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:32.327566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.328095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.328531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.329224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.329677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.330101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.346823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:32.354381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1bac522-fd96-467a-88c9-9e0d62b55bde tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085215 Sep 01 08:27:32.354939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1583/3140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:32 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:32.435047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:32.435663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:32.442992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.443482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.443919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.444624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.445073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.445491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.553283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:32.562840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:32.564284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:32.565457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-65ebd9fc-d897-4a1d-9bb6-2a0ed1e1a80a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.248441 Sep 01 08:27:32.566008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1558/3141] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:32 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:32.570388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:32.570987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:32.577463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.577948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.578418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.579117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:32.579507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:32.579635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:32.579970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:32.587695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d72a76c0-f78c-46eb-a574-fa6a5b33e533 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.158745 Sep 01 08:27:32.588257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1584/3142] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:32 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:32.641023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:32.648937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-557edfe2-598c-4ae4-beb6-83af267d71a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081965 Sep 01 08:27:32.649517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1559/3143] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:32 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:33.196262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:33.196877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:33.203876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.204401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.204846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.205621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.206082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.206549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.269059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:33.276730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1a44de92-c1ee-4bbc-9272-9a07146885bf tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084305 Sep 01 08:27:33.277357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1585/3144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:33 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:33.376385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:33.376991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:33.383101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.383584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.384016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.384700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.385143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.385559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.449465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:33.457487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5df32f37-da15-422d-9bcc-22d78a3786f8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085652 Sep 01 08:27:33.458052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1560/3145] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:33 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:33.587563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:33.588171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:33.595182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.595675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.596106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.596799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.597251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.597673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.608966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:33.609592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:33.616842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.617334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.617763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.618490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.618944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.619389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.663351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:33.672471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:33.674006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:33.675175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eedd72a9-3d7e-4718-90c7-cb00ee4ee928 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091620 Sep 01 08:27:33.676245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1586/3146] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:33 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:33.680988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:33.681588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:33.684507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:33.688674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.689158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.689587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.690288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:33.690738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:33.691155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:33.693166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:33.700879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61903be4-e906-44b6-b34c-9c6c69f8d47d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095871 Sep 01 08:27:33.701377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1561/3147] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:33 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:33.751239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:33.758624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4c71a6ac-6978-4c0c-a7d1-a0a906145ebf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081436 Sep 01 08:27:33.759177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1587/3148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:33 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:34.298278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:34.298884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:34.305037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.305517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.305943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.306697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.307138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.307558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.371668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:34.380205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eddbe041-5625-4f13-8e2b-2daf9fb2f8c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086339 Sep 01 08:27:34.380888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1562/3149] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:34 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:34.477242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:34.477846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:34.484566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.485040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.485469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.486152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.486618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.487056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.547650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:34.555430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-616db217-5f22-412a-9567-81e76ce04623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081920 Sep 01 08:27:34.556226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1588/3150] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:34 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:34.697763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:34.698381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:34.708651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.709239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.709564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.710277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.710722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.711137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.721032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:34.721636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:34.732179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.732683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.733659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.734613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.735073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.735497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.774156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:34.782338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:34.783758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:34.784851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-acc11f07-952b-4d8b-9044-e728e7be4644 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090965 Sep 01 08:27:34.785402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1563/3151] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:34 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:34.789786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:34.790399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:34.797859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.798390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.798837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.799528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:34.799742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:34.799978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:34.800421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:34.807354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-10231a15-5895-469c-b37a-b99c264b755a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090211 Sep 01 08:27:34.807851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1589/3152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:34 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:34.861332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:34.868758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e0719d24-f7b9-4952-85a2-0dcb076ea406 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082430 Sep 01 08:27:34.869310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1564/3153] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:34 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:35.401002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:35.401664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:35.408431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.408910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.409341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.410030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.410510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.410933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.474979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:35.482866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ceb27ea8-ce87-4e95-8e94-d6beb5565f77 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085679 Sep 01 08:27:35.483583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1590/3154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:35 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:35.576361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:35.577822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:35.584159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.584644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.585078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.585773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.586222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.586669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.647212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:35.654842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d4675d6-d811-4f99-bae7-1b35e2e4b035 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082302 Sep 01 08:27:35.655959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1565/3155] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:35 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:35.807526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:35.808238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:35.814849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.815325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.815750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.816428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.816873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.817282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.821236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:35.827648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:35.828254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:35.830172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:35.835608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.836125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.836555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.837242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.837686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.838103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.881737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:35.890998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:35.892389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:35.893490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b2e1542b-a17b-433f-aa40-60454e78f87f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089869 Sep 01 08:27:35.894065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1591/3156] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:35 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:35.898384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:35.898976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:35.905488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.905914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.906371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.907049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:35.907488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:35.907901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:35.909546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:35.917049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-efe07497-45a1-4360-991b-7d8fa11856f5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093193 Sep 01 08:27:35.917615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1566/3157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:35 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:35.970485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:35.977951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b70230f2-2795-406c-905c-c96acba2e7a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082923 Sep 01 08:27:35.978540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1592/3158] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:35 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:36.503905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:36.504505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:36.510486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.510966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.511396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.512076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.512519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.512932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.578211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:36.580584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:36.588462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e1b7de75-d688-4411-b2ac-957ccf6cd621 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088343 Sep 01 08:27:36.589033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1567/3159] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:36 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:36.675594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:36.676614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:36.683356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.683837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.684268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.684953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.685395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.685836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.746086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:36.754280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-68ec910e-88c4-4fc9-8db6-38f2c3f77c44 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082824 Sep 01 08:27:36.754849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1593/3160] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:36 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:36.916187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:36.916703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:36.923573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.924067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.924502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.925221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.925672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.926096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.939578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:36.940184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:36.946119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.946635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.947067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.947752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:36.948208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:36.948631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:36.988372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:36.996611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:36.998032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:36.999735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-da17e4e7-f08a-480a-b807-1a46b179cd35 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086964 Sep 01 08:27:37.000284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1568/3161] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:36 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:37.004786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:37.005377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:37.011265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:37.011743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:37.012167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:37.012846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:37.013287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:37.013700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:37.017488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:37.025332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4ec96783-ffc4-45ae-9df7-6c02f5c8459e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090298 Sep 01 08:27:37.025968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1594/3162] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:36 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:37.074039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:37.081997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-312213ed-2043-4a5c-a5ff-97cce25747ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080772 Sep 01 08:27:37.082842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1569/3163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:37 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:37.609015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:37.609621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:37.615602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:37.616077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:37.616505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:37.617183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:37.617636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:37.618055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:37.679127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:37.687460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d113b72-7e07-4177-b21d-dae99ecb6f1a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082319 Sep 01 08:27:37.688148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1595/3164] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:37 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:37.775467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:37.776019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:37.782209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:37.782715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:37.783136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:37.783827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:37.784260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:37.784680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:37.845509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:37.853749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-29e34a62-bc4f-4204-8cfb-5f6fa4ee8155 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082150 Sep 01 08:27:37.854318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1570/3165] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:37 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:38.021266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:38.021890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:38.027944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.028366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.028796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.029478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.030498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.031018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.044832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:38.045441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:38.052516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.053003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.053434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.054125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.054623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.055049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.097858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:38.106174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:38.107633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:38.109473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca800188-7b83-47a8-b048-b92c4f8900ea tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092139 Sep 01 08:27:38.110088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1596/3166] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:38 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:38.114451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:38.115048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:38.120931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.121796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.122236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.122945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.123392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.124039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.124628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:38.132419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-98a20fe6-908e-45ba-bc23-7b37fd601302 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.091321 Sep 01 08:27:38.132990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1571/3167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:38 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:38.185121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:38.192945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9ab9b0b9-b6cc-4d63-8aa8-4991083ab2ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081930 Sep 01 08:27:38.193507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1597/3168] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:38 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:38.712591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:38.713142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:38.719689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.720164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.720595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.721276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.721722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.722144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.784576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:38.792304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-12c3c638-e6aa-4f70-ac6d-d0ef4656eff1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083613 Sep 01 08:27:38.792876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1572/3169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:38 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:38.876219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:38.876831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:38.882998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.883478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.883910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.884657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:38.885132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:38.885556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:38.946691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:38.955387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3f7d10ce-ab32-4e50-9dfa-45d4f08a4cbb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083754 Sep 01 08:27:38.955940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1598/3170] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:38 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:39.131904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:39.132513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:39.138483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.138968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.139427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.140370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.140822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.141288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.152959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:39.153600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:39.159814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.160298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.160817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.161510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.162349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.162523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.213419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:39.221828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:39.223267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:39.224352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0bb5deab-6dea-4256-b0c1-ba95e0c52610 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096351 Sep 01 08:27:39.224895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1573/3171] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:39 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:39.229203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:39.229790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:39.235366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:39.236236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.236590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.237019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.237896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.238533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.238773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.243153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a44ab04a-a363-4625-8a73-e990bf392618 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093997 Sep 01 08:27:39.243716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1599/3172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:39 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:39.298813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:39.306232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b07deced-3eb9-4e61-a388-9b2ebac2c2f0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.080415 Sep 01 08:27:39.306930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1574/3173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:39 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:39.814819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:39.815427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:39.821481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.821963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.822429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.823114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.823563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.823985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.884743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:39.893160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-576783f6-dc51-4d8d-b96d-7b895553035d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082237 Sep 01 08:27:39.893733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1600/3174] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:39 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:39.976195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:39.976806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:39.982808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.983316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.983751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:39.984468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:39.984862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:39.985276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.048839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:40.056430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d2b619a5-363d-47ae-aa84-1734ca463815 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084103 Sep 01 08:27:40.056986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1575/3175] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:39 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:40.247486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:40.247998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:40.254544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.255024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.255455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.256127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.256566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.256978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.265144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:40.265784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:40.271687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.272167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.272600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.273280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.273727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.274143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.318660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:40.327523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:40.329006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:40.330101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1ffb9784-3150-4929-ae33-f72adba6bcf2 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086571 Sep 01 08:27:40.330767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1601/3176] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:40 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:40.335433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:40.336026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:40.341827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.342488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.342960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.343736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.344182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.344605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.346047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:40.353859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-549cb0b0-4fa0-4cf2-8e12-10acd941396a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093179 Sep 01 08:27:40.354726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1576/3177] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:40 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:40.406414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:40.413960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30d334f6-21e5-4f3a-8fda-6ef80120f3f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082263 Sep 01 08:27:40.414551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1602/3178] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:40 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:40.914155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:40.914800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:40.921416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.921971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.922501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.923188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:40.923645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:40.924069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:40.985182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:40.992861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3d3f435a-1eb8-4fa3-ba38-985a3ac0ed29 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082601 Sep 01 08:27:40.993428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1577/3179] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:40 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:41.080467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:41.081083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:41.089327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.089813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.090459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.090976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.091419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.091841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.156985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:41.164725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16c1262a-eabb-4727-8534-ec106ae79343 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091902 Sep 01 08:27:41.165230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1603/3180] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:41 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:41.354507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:41.355102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:41.361804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.362310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.362748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.363458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.363903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.364321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.374276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:41.374872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:41.380773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.381245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.381672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.382372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.382819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.383235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.431660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:41.444870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:41.446326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:41.447473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-511a4693-57d9-4cd6-ad03-439b08c84589 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096873 Sep 01 08:27:41.448019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1578/3181] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:41 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:41.453211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:41.453821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:41.458283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:41.460187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.460675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.461107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.461805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:41.462253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:41.462707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:41.468991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e39c08b-1119-498f-a723-3bed580d7b7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.098431 Sep 01 08:27:41.472539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1604/3182] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:41 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:41.523925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:41.531405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-58df8f7b-ab91-4d6d-b759-cdc8527cde96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082435 Sep 01 08:27:41.532401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1579/3183] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:41 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:42.014199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:42.015623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:42.021698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.022167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.022630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.023394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.023840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.024255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.088305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:42.096603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fa8c58f9-bbec-4727-a3e0-75a791c29a41 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086174 Sep 01 08:27:42.097173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1605/3184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:42 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:42.185686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:42.186623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:42.192602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.193076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.193506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.194183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.194663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.195076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.258984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:42.267256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1288ece1-a063-4a4e-9608-cfb05ab45860 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085346 Sep 01 08:27:42.267753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1580/3185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:42 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:42.469697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:42.470335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:42.476416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.476894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.477325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.478017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.478495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.478917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.488820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:42.489434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:42.495428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.495899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.496326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.497001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.497442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.497885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.549297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:42.557615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:42.559069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:42.560158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-714a6061-21c8-4901-9cf1-5d1dff6affe1 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095231 Sep 01 08:27:42.560712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1606/3186] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:42 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:42.569308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:42.571343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:42.571951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:42.579184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.579756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.580186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.580883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:42.581289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d0a3444f-2150-426a-83f4-199c3b1ab349 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.096187 Sep 01 08:27:42.581424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:42.581727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:42.582418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1581/3187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:42 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:42.643752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:42.647068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:42.652091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f5b95733-6fc2-4bb5-be4c-bb319d0f9e3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084380 Sep 01 08:27:42.652653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1607/3188] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:42 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:43.117815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:43.118469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:43.125497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.126016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.126478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.127255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.127703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.128141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.192190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:43.200069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8979817a-81e5-4e87-a4ac-45968ecf632a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.086082 Sep 01 08:27:43.200645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1582/3189] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:43 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:43.287675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:43.288382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:43.294910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.295391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.295827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.296675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.297125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.297548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.359525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:43.367069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6822ad51-f9d5-4a5c-a4cb-e67d16c6afc1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083298 Sep 01 08:27:43.367634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1608/3190] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:43 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:43.584245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:43.584847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:43.590860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.591337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.591769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.592464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.592902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.593427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.602159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:43.602785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:43.609347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.609766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.610385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.611084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.611535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.611962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.656633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:43.664972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:43.666474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:43.667586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-33c4a729-1ac0-4e2c-b686-61adca499bfa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087492 Sep 01 08:27:43.668142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1583/3191] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:43 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:43.673276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:43.673883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:43.680060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.680602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.681112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.681879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:43.682433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:43.682566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:43.682861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:43.691501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-481d81af-cd2c-4f64-896b-f09c0bfd43a9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093049 Sep 01 08:27:43.692074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1609/3192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:43 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:43.698612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:43.744306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:43.752553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-35ba46ce-de67-4211-a1ca-755106f8ebf4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083454 Sep 01 08:27:43.753227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1584/3193] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:43 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:44.222385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:44.223019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:44.229021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.229501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.229932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.230647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.231094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.231512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.293174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:44.301674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b1a69ddb-ec57-4d5d-997d-870092c42550 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083234 Sep 01 08:27:44.302248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1610/3194] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:44 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:44.388280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:44.388977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:44.395744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.396228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.396659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.397352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.397793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.398207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.460575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:44.469161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9b4281c9-4c02-4905-9351-b3cf271c3f9b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084860 Sep 01 08:27:44.469733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1585/3195] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:44 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:44.691121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:44.691725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:44.697801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.698308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.698747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.699436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.699884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.700300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.712624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:44.713235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:44.719622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.720117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.720551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.721247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.721697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.722119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.776950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:44.786079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:44.787522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:44.788601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b6988f4-7037-43b5-a398-13a98a2748a0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.101371 Sep 01 08:27:44.789157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1611/3196] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:44 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:44.793491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:44.794091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:44.797979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:44.800703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.801174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.801795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.802534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:44.802981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:44.803392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:44.805609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a9271c3-8356-40f8-8709-b4d600967211 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.097153 Sep 01 08:27:44.806191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1586/3197] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:44 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:44.863638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:44.871126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1f6addc-d579-4029-b0e7-6c5ec36b04ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081033 Sep 01 08:27:44.871679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1612/3198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:44 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:45.322632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:45.323242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:45.329894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.330411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.330847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.331547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.332254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.332685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.395991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:45.403527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1698a2a9-9a96-4d45-920d-7c99dbb319ea tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084872 Sep 01 08:27:45.404088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1587/3199] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:45 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:45.489733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:45.490378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:45.496675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.497161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.497629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.498362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.499486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.499914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.562203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:45.569725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ca2be9f-79e3-422b-9da7-149f05b719c0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083895 Sep 01 08:27:45.570300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1613/3200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:45 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:45.811440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:45.812044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:45.817978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.818486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.818920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.819594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.820043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.820463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.826335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:45.827122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:45.833142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.833620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.834051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.834755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.835203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.835621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.891590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:45.900053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:45.901484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:45.902606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0946a49d-8405-4358-9267-2efb7a947c94 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095002 Sep 01 08:27:45.903161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1588/3201] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:45 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:45.908780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:45.909250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:45.914948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:45.915235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.915718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.916152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.916839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:45.917285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:45.917890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:45.923151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3b1a916d-964b-4879-b0a3-5d6f3fcb44e8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100572 Sep 01 08:27:45.923739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1614/3202] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:45 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:45.981308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:45.990402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-671180a4-a98b-4ac7-95c3-e354bff9e05e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086226 Sep 01 08:27:45.990966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1589/3203] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:45 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:46.424411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:46.425006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:46.431106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.431583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.432008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:46.432692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.433141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.433554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:46.494492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:46.502777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca1aa132-8162-40b8-b4d2-e28c600c785a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082525 Sep 01 08:27:46.503336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1615/3204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:46 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:46.591606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:46.592200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:46.599016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.599500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.599929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:46.600624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.601076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.601498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:46.664102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:46.671745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf513ddf-a9df-404a-8d16-13cccf27b61b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084093 Sep 01 08:27:46.672302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1590/3205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:46 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:46.925336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:46.925935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:46.931884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.932357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.932786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:46.933463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.933909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.934346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:46.942565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:46.943171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:46.949003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.949485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.949914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:46.950620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:46.951067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:46.951568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:47.005310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:47.013853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:47.015936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:47.017027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-80bc1ec7-9198-4537-af7e-d6c3b3656563 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095633 Sep 01 08:27:47.017615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1616/3206] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:46 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:47.021982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:47.022605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:47.026025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:47.028433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:47.028918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:47.029805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:47.030534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:47.031163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:47.031679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:47.033914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2e32d61-337e-4533-b5a5-313649e3b736 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095048 Sep 01 08:27:47.034513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1591/3207] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:46 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:47.095351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:47.102958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8b72898f-6538-4b7b-a1db-dd8b0e7348df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084392 Sep 01 08:27:47.103513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1617/3208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:47 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:47.523442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:47.524042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:47.531546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:47.532042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:47.532482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:47.533178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:47.533631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:47.534093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:47.597341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:47.605019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dbfec815-3531-4c06-8db1-e25cd646030f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085413 Sep 01 08:27:47.605584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1592/3209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:47 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:47.693108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:47.693707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:47.699722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:47.700227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:47.700655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:47.701336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:47.701923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:47.702478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:47.764168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:47.772120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1f476df3-62cb-4795-a288-d4689a7b18df tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083024 Sep 01 08:27:47.772682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1618/3210] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:47 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:48.040253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:48.040854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:48.047101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.047575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.047999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.048676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.049117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.049528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.053350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:48.053985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:48.059718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.060191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.060615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.061871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.062378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.062843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.119291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:48.128184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:48.129763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:48.131084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-86b8341c-fbd0-4fd0-85ab-7edd70693e09 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.094578 Sep 01 08:27:48.131438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1593/3211] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:48 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:48.135892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:48.136475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:48.143193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.143673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.144099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.144777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.145221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.145638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.148766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:48.156998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-72c3f216-e805-4102-b066-ab1175aecafa tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.107443 Sep 01 08:27:48.157572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1619/3212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:48 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:48.206852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:48.214697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cbda27e4-6aaf-4ab4-ac11-29077a910f4d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082264 Sep 01 08:27:48.215251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1594/3213] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:48 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:48.627043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:48.627649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:48.633598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.634075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.634536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.635227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.635672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.636090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.696432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:48.704576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47e27767-d814-464b-96f5-cc5e9e657021 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081935 Sep 01 08:27:48.705133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1620/3214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:48 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:48.793209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:48.793817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:48.800080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.800552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.800977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.801667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:48.802105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:48.802570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:48.865203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:48.872865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cc7b9641-0c58-42ce-8dec-b5f2089768ac tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083513 Sep 01 08:27:48.873419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1595/3215] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:48 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:49.156596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:49.157109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:49.163262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.163729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.164156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.164831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.165277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.165689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.177397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:49.178040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:49.183983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.184468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.184933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.185620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.186707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.187475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.230334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:49.239457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:49.240686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:49.241772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3e741a31-b8b5-4620-8127-9665e0fa29b9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089408 Sep 01 08:27:49.242343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1621/3216] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:49 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:49.249768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:49.250590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:49.256726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.257227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:49.257582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.258027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.258874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.259330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.259754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.265314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ebf1086c-80de-4bf8-898c-655680ad624e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.091667 Sep 01 08:27:49.266042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1596/3217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:49 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:49.321910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:49.329849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4d56e70-1150-427c-b40e-14cfc40eb4ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084318 Sep 01 08:27:49.330441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1622/3218] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:49 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:49.725369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:49.725887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:49.731949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.732428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.732879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.733624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.734075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.734539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.794502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:49.802053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-34ed0c01-eb38-435e-b68a-a43f7a15450f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.080676 Sep 01 08:27:49.802722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1597/3219] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:49 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:49.895539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:49.896217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:49.902468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.902949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.903377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.904066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:49.904509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:49.905471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:49.968571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:49.977051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a724f15f-927d-43cc-8f27-38483b33a224 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085175 Sep 01 08:27:49.977534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1623/3220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:49 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:50.264799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:50.265319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:50.271228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.271702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.272126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.272799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.273239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.273654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.286557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:50.287164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:50.293008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.293485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.293917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.294622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.295069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.295491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.314471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:50.337915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:50.346426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:50.347854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:50.348950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a590340c-b243-43ae-95f4-caa20c65e968 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088751 Sep 01 08:27:50.349499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1598/3221] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:50 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:50.362461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:50.363067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:50.367001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:50.368982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.369458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.369882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.370603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.371049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.371488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.375318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee5fa4e4-4ebe-4aa5-840a-b95bdd7e833a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.092521 Sep 01 08:27:50.376233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1624/3222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:50 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:50.432811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:50.441411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-73c4c42f-e972-4ffe-a253-17861452c8f5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090920 Sep 01 08:27:50.442027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1599/3223] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:50 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:50.823210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:50.823812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:50.830848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.831388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.831771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.832720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:50.833172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:50.833598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:50.895391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:50.902935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f5ad7ced-2cb6-4fa7-9880-db15d6a6bf28 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083666 Sep 01 08:27:50.903496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1625/3224] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:50 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:50.997258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:50.997879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:51.004515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.004998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.005430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.006130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.006986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.007168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.073170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:51.082960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e108fb7-a946-479b-bfa3-fb8961d8f810 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088993 Sep 01 08:27:51.083475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1600/3225] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:50 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:51.371508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:51.372008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:51.378071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.378581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.379016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.379695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.380142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.380560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.396181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:51.396791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:51.402687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.403165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.403601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.404285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.404888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.405897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.409943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:51.444374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:51.453120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:51.454560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:51.455658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-534514b8-85d1-479a-b433-75ff9797f7d3 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088183 Sep 01 08:27:51.456408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1626/3226] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:51 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:51.462629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:51.463229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:51.470423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.471000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.471764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.472696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.473156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.473579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.473712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:51.481845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-729ecd80-77dc-43ae-a4d4-3a301ee983c1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.089388 Sep 01 08:27:51.482433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1601/3227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:51 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:51.539480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:51.547537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-15978a7e-2516-4b16-9bd5-31d67a963139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.088469 Sep 01 08:27:51.548089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1627/3228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:51 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:51.924168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:51.924763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:51.930798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.931281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.931709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.932391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:51.932835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:51.933253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:51.993510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:52.001658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc8c4712-c44f-40b8-89df-53a12be534df tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081964 Sep 01 08:27:52.002413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1602/3229] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:51 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:52.103870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:52.104475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:52.111654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.112152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.112582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.113298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.113752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.114174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.180130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:52.187983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3d0d1837-c7eb-4669-969c-8fbfaca5c96b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087896 Sep 01 08:27:52.188547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1628/3230] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:52 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:52.482130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:52.482768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:52.488874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.489340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.489769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.490490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.490941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.491358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.505223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:52.505817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:52.511764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.512234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.512661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.513339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.513778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.514291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.553691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:52.562920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:52.564517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:52.565623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb0c47ee-3806-4db1-9d80-444aacd5996e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087411 Sep 01 08:27:52.566180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1603/3231] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:52 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:52.570665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:52.571266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:52.577723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.578597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.579038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.579738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:52.580187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:52.580611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:52.582722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:52.590208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf563e34-e299-4464-b4f6-ff7741aa8261 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088764 Sep 01 08:27:52.590808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1629/3232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:52 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:52.642293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:52.649847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a5e1c5d8-42e8-4863-a246-a74de1e38100 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.082682 Sep 01 08:27:52.650429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1604/3233] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:52 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:53.021872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:53.022503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:53.028577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.029063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.029496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.030188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.031201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.031685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.103177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:53.108697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b5ad7084-b2e3-43d2-b529-9e6f851d3af0 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090720 Sep 01 08:27:53.110215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1630/3234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:53 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:53.208657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:53.209298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:53.211315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:27:53.211457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d (ip 10.222.0.43) !!! Sep 01 08:27:53.216999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.217480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.217911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.219139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.219585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.220004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.284104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:53.291893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9e1ec097-0551-48c2-a730-3979f06c606f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087292 Sep 01 08:27:53.292468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1605/3235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:53 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:53.588909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:53.589505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:53.596103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.596580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.597007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.597683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.598128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.598620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.610976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:53.611596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:53.617886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.618408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.618865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.619550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.620002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.620426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.669505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:53.677896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:53.679345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:53.680433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-416a528d-4f7b-41bc-a202-0596d32c0cee tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095546 Sep 01 08:27:53.681185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1631/3236] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:53 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:53.685294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:53.685977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:53.689101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:53.692159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.693246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.693683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.694477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:53.694999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:53.695572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:53.697378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8402cb74-6087-4203-a6ed-4f466ddef0ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090625 Sep 01 08:27:53.698071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1606/3237] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:53 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:53.756114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:53.763575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7df64db1-3dc3-46e8-85fc-6430074787b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.081669 Sep 01 08:27:53.764134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1632/3238] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:53 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:54.130248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:54.130885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:54.132891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:27:54.133036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 (ip 10.222.0.43) !!! Sep 01 08:27:54.139513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.140501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.140935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.141630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.142072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.142519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.207646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:54.215181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e25c7d27-86a7-4b8d-8ac4-95f2639c8fda tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088815 Sep 01 08:27:54.215744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1607/3239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:54 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:54.313336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:54.313930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:54.320216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.320667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.321095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.321765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.322209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.322654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.382743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:54.391418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac00ac78-f8e3-4fa2-a40b-b65f7628b110 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082049 Sep 01 08:27:54.392003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1633/3240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:54 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:54.704075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:54.704598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:54.710884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.711364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.711799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.712483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.712934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.713368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.718182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:54.718947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:54.724993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.725472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.725903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.726616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.727069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.727490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.783785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:54.792604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:54.794021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:54.795146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-32373ae8-a707-4cb5-9615-cb63d4b9fb2c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095775 Sep 01 08:27:54.795981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1608/3241] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:54 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:54.801136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:54.801736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:54.807603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.808069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.808499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.809178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:54.809617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:54.810027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:54.814545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:54.822050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f4db46a-2f84-4e89-8762-96637643d4c5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.107678 Sep 01 08:27:54.822729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1634/3242] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:54 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:54.872199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:54.879882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5173ec87-686b-40db-a80e-6645c741bcb9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083087 Sep 01 08:27:54.880439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1609/3243] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:54 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:55.236192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:55.236889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:55.242934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.243419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.243843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.244523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.244965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.245393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.306020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:55.313860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd776729-7479-40bd-a152-9c77dacf03bc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082002 Sep 01 08:27:55.314524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1635/3244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:55 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:55.413001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:55.413617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:55.419558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.420030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.420453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.421128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.421567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.421981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.483788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:55.494299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2f6aab2-1eea-4195-9f77-28bd9dcb78eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085023 Sep 01 08:27:55.494844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1610/3245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:55 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:55.818292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:55.818966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:55.824879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.825358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.825788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.826526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.826975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.827396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.843716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:55.844317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:55.850833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.851293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.851723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.852400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.852843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.853256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.889058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:55.898143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:55.899592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:55.900688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-761b4c4a-0dbe-4941-9938-90e17b3d2225 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.086515 Sep 01 08:27:55.901566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1636/3246] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:55 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:55.905946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:55.906558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:55.909048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:55.914244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.914748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.915178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.915857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:55.916297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:55.916711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:55.918895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:55.926575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-afbb61c9-7ffa-49ae-8cef-31eb68591f15 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086817 Sep 01 08:27:55.927142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1611/3247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:55 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:55.979959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:55.987651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8daf1795-acec-403e-a94a-265590c41a7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085072 Sep 01 08:27:55.988218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1637/3248] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:55 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:56.335806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:56.336439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:56.343227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.343730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.344145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.344912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.345940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.346453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.406888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:56.415473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-33913572-fc72-43cb-969e-8defb352e313 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083697 Sep 01 08:27:56.416113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1612/3249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:56 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:56.516612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:56.517979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:56.524053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.524532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.524954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.525725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.526074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.526513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.592388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:56.600306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-83a2d131-0d8d-4dab-81b8-533d9997892e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087461 Sep 01 08:27:56.600888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1638/3250] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:56 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:56.924229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:56.924854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:56.930768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.931242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.931668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.932335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.932777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.933192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.947491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:56.948100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:56.953922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.955086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.955526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.956219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:56.956670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:56.957363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:56.995347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:57.004677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:57.006096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:57.007225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-137e01dd-87dc-4e4f-a822-ada802bc9ea4 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.087143 Sep 01 08:27:57.007777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1613/3251] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:56 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:57.012523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:57.013119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:57.019868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:57.020350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:57.020779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:57.021463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:57.021906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:57.022345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:57.023465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:57.031170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3aeec44e-b337-43d8-b1c4-3514d880fab5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087481 Sep 01 08:27:57.031732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1639/3252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:56 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:57.099283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:57.106927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47b024ef-4f3e-4dd9-9ece-cd91606005ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.097978 Sep 01 08:27:57.107494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1614/3253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:57 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:57.435925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:57.436556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:57.443546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:57.444031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:57.444461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:57.445156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:57.445598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:57.446018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:57.506898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:57.514473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-69a68356-fb6a-4900-a5bb-4eb0997d7e88 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.082381 Sep 01 08:27:57.515136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1640/3254] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:57 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:57.622690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:57.623294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:57.629359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:57.629859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:57.630310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:57.630985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:57.631423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:57.631832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:57.693238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:57.701142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-998b1065-fd61-4ffb-a8aa-f3fa9735d782 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082161 Sep 01 08:27:57.701685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1615/3255] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:57 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:58.029194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:58.029785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:58.036904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.037388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.037825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.038568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.039004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.039428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.043599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:58.051843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:58.052458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:58.054404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:58.059615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.060105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.060576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.061238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.061814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.062434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.104529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:58.113170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:58.114626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:58.115744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1efb7562-1885-46a4-8117-99bf9ce7b69d tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.090473 Sep 01 08:27:58.116300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1641/3256] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:58 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:27:58.128215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:58.128828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:58.134057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:58.135370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.135851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.136343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.136976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.137423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.137843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.143051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-35fe174a-4030-40b2-9fc9-e32670ff7230 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.094996 Sep 01 08:27:58.143731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1616/3257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:58 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:58.202861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:58.211261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3ae5f98a-ca03-493b-9266-7e9b7ca9eb15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087028 Sep 01 08:27:58.211827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1642/3258] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:58 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:27:58.535389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:58.536095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:58.542393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.542877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.543303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.543992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.544433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.544846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.613536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:58.615715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:58.622479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1604da0-205c-4628-bfb5-df602444495d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091345 Sep 01 08:27:58.623047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1617/3259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:58 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:58.723461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:58.723976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:58.729945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.730520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.730949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.731627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:58.732072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:58.732483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:58.797557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:58.806320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c6c6cf5-405b-4949-aa20-008c67fba59a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087323 Sep 01 08:27:58.806918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1643/3260] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:58 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:59.138966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:59.139593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:59.146719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.147203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.147636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.148324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.148767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.149191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.166729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:59.167827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:59.178786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.179641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.180414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.181674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.182551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.183323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.216323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:59.227431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:59.229016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:59.230181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f1c9c4b2-7774-4a50-b473-cecd60b01368 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095417 Sep 01 08:27:59.230884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1618/3261] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:27:59 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:27:59.236282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:59.237074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:59.244273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.245065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.245690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.246450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.246931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.247362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.268396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:59.276904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4991a00b-660e-406e-9a89-aa78f453b7a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.116197 Sep 01 08:27:59.277489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1644/3262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:59 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:59.318601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:59.326592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d0df8bfb-2e50-46e2-9327-32bdd7be0743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094586 Sep 01 08:27:59.327253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1619/3263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:59 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:59.643985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:59.644636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:59.650874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.651362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.651795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.652493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.652949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.653375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.719468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:59.728422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5cbbcd06-d4fa-425e-8f55-2b9763fe4cb4 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088482 Sep 01 08:27:59.729063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1645/3264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:59 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:27:59.828921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:27:59.829792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:27:59.836824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.837305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.837736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.838487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:27:59.838979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:27:59.839397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:27:59.908501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:27:59.916544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3d2a121-8c98-4ea8-93b9-fae951c93a07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091656 Sep 01 08:27:59.917122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1620/3265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:27:59 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:00.254368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:00.254964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:00.261556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.262037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.262490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.263184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.263633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.264043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.309427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:00.310137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:00.317684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.318165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.318629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.319321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.319762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.320180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.326816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:00.335611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:00.337062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:00.338176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfe4190a-22ef-423b-b61c-243fa24e1211 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.088322 Sep 01 08:28:00.338789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1646/3266] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:00 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:00.349533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:00.350434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:00.362972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.363599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.364103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.364878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.365396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.365890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.391346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:00.401085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fd4aa0ee-37e0-4ebf-bc32-488616113ac6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.096410 Sep 01 08:28:00.401667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1621/3267] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:00 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:00.433735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:00.442538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d828b76-5cfe-4788-a88f-1f87e19cb247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.097494 Sep 01 08:28:00.443115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1647/3268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:00 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:00.751608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:00.752477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:00.758701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.759359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.759951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.760858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.761317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.761775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.831201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:00.842596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b378b7fd-f896-441d-a8cb-6b2878dbd1dd tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.096473 Sep 01 08:28:00.843182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1622/3269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:00 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:00.938151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:00.938825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:00.945124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.945600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.946033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:00.946771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:00.947220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:00.947640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.011245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:01.019687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c6bd0595-7847-4118-bfea-f03825d4ef7d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085286 Sep 01 08:28:01.020255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1648/3270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:00 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:01.362315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:01.362925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:01.369261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.369746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.370179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.370905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.371361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.371777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.422757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:01.423968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:01.431111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.431596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.432033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.432737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.433196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.433625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.438241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:01.450124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:01.451627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:01.452790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b041f491-c2a7-4eea-a936-92bee05ac153 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095538 Sep 01 08:28:01.453481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1623/3271] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:01 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:01.465365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:01.466125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:01.473810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.474325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.474772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.475497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.475958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.476386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.503616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:01.511796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ecc794b7-f753-4ba2-8a53-b2927341307b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.092803 Sep 01 08:28:01.512478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1649/3272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:01 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:01.550331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:01.558709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-235aee83-078d-4fea-80b1-4b15af6ec560 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.098032 Sep 01 08:28:01.559300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1624/3273] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:01 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:01.865243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:01.865874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:01.874862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.875360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.875799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.877122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:01.877589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:01.878150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:01.947721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:01.957286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13e2bd58-4f4c-47af-83a8-9071661bf8a1 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.096324 Sep 01 08:28:01.957890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1650/3274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:01 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:02.041519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:02.042467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:02.049187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.049682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.050113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.050859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.051310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.051732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.132135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:02.140389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-967cafd4-c122-4188-a92b-83babd15c01b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.102783 Sep 01 08:28:02.140994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1625/3275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:02 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:02.477642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:02.478813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:02.485405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.486477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.486916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.487620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.488067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.488495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.536690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:02.537400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:02.545161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.545846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.546453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.547294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.547870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.548975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.555361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:02.572010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:02.575174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:02.577339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c3bfe010-7092-4f53-bde8-100dca4ece6a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.103690 Sep 01 08:28:02.578391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1651/3276] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:02 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:02.593042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:02.594131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:02.604400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.605250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.606019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.607298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.608091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.608827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.633864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:02.646712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-466d4a4b-9c15-4bdf-b281-4c96a5c3b9ee tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.113750 Sep 01 08:28:02.647619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1626/3277] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:02 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:02.847309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:02.858699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e1af2fee-3c38-46b5-9897-ef52c743e5db tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.278495 Sep 01 08:28:02.859300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1652/3278] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:02 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:02.978703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:02.979310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:02.985742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.986390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.986733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:02.987475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:02.987932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:02.988359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.064845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:03.073044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fcfc881f-3ab6-467f-b109-5273a6cf8a97 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.098270 Sep 01 08:28:03.073622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1627/3279] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:02 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:03.175226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:03.175742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:03.184138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.184695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.185175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.185881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.186358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.186783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.266929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:03.275405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f74a2bc7-3149-4612-a6a3-e3d588b4e392 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.104953 Sep 01 08:28:03.275989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1653/3280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:03 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:03.601731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:03.602442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:03.608859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.609467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.609962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.611351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.611844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.612368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.674005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:03.675188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:03.678689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:03.681989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.682801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.683339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.684113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.684730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.685263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.687452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:03.689035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:03.690431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6954d4d8-f956-4cf4-8ec6-3f8b5bdc304c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092604 Sep 01 08:28:03.691001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1628/3281] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:03 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:03.763739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:03.772185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-66475f0b-8e75-47c9-920e-3144ed3bd7ef tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.103081 Sep 01 08:28:03.772761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1654/3282] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:03 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:03.889486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:03.890721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:03.901902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.902797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.903435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.904669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:03.905488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:03.906390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:03.973845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:03.982029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eab7bffe-6132-4c7c-8cfe-5d45b17d7d51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.100243 Sep 01 08:28:03.982643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1629/3283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:03 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:04.096106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:04.096739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:04.103056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.103521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.103950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.104649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.105101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.105521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.171779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:04.181233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7fcc017a-bdf5-42c2-9790-6fc8d6498f86 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.089671 Sep 01 08:28:04.181836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1655/3284] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:04 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:04.296525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:04.297168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:04.305055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.305615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.306099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.306957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.307503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.308036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.373450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:04.382523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cf40a35e-997a-4390-b7c9-12f78a76c951 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089756 Sep 01 08:28:04.383293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1630/3285] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:04 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:04.717186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:04.717829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:04.724876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.725368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.725804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.726542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.726995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.727421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.793174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:04.794246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:04.796639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:04.801214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.801710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.802150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.802898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:04.803358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:04.803823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:04.805663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:04.807200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:04.808345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7414bea-0889-4181-ac0c-1c6f648f7e97 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.095159 Sep 01 08:28:04.809156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1656/3286] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:04 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:04.881830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:04.890034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-11d040e9-2161-4f09-b217-503de1f930f3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100726 Sep 01 08:28:04.890664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1631/3287] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:04 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:05.003732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:05.004255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:05.010902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.011386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.011826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.012531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.012974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.013388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.075980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:05.080119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:05.085315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-232e2e37-c3b3-4e2e-8c90-844bbb6e5f07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086063 Sep 01 08:28:05.085855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1657/3288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:04 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:05.203607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:05.204988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:05.211625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.212110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.212540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.213230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.213678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.214097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.281011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:05.289812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8c85d9f-5b26-4469-b65d-c751e74c322f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090414 Sep 01 08:28:05.290530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1632/3289] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:05 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:05.415889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:05.416555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:05.423673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.424158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.424678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.425375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.425820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.426234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.496158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:05.505285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-53bee348-2c2a-4738-91f0-c552b627a335 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.093184 Sep 01 08:28:05.505872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1658/3290] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:05 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:05.836580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:05.837605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:05.848262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.849057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.849772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.851020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.851811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.852537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.912135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:05.913417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:05.920845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.921439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.922202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.923433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:05.924209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:05.924700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:05.943544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:05.952875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:05.954969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:05.956444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7122badc-27b0-4e8c-a6f8-280daa337233 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.127993 Sep 01 08:28:05.957573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1633/3291] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:05 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:06.008570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:06.017629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e8ea04d6-0ff6-4046-acdd-6bc4a8571403 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.109301 Sep 01 08:28:06.018399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1659/3292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:05 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:06.106232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:06.106834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:06.114063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.114579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.115020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:06.115744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.116203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.116637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:06.133289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:06.189868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:06.203515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-641d85e3-5b80-4edb-bd98-eb55db083f0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.100862 Sep 01 08:28:06.204510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1634/3293] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:06 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:06.310175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:06.310858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:06.318092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.318619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.319052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:06.319755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.320205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.320629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:06.391438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:06.404416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4cdb451a-6748-483f-80d4-0d501b3299e9 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.098001 Sep 01 08:28:06.405258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1660/3294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:06 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:06.527091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:06.527695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:06.534558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.535046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.535511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:06.536205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.536709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.537137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:06.601540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:06.609472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b7f229c3-cca7-4dbb-9a5b-712b05d98f7e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086238 Sep 01 08:28:06.610172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1635/3295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:06 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:06.979404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:06.980012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:06.986418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.986960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.987399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:06.988103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:06.988555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:06.988984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.040140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:07.040733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:07.046834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.047313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.047746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.049031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.049480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.049896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.055271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:07.070266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:07.073167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:07.075320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-63c3e3eb-119f-4740-9135-b5831773494e tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.099522 Sep 01 08:28:07.076425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1661/3296] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:06 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:07.113343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:07.121207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e27700ed-09af-4105-bd57-798fab34b44c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084850 Sep 01 08:28:07.121770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1636/3297] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:07 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:07.233722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:07.234233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:07.240819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.241296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.241731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.242524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.242969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.243382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.308515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:07.317241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-967ac3b3-b203-4620-a0c2-556a84d39452 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087412 Sep 01 08:28:07.317812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1662/3298] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:07 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:07.436262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:07.437019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:07.444652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.445162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.445589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.446294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.446770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.447235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.515510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:07.529465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26e0e5f5-12d6-4aaf-bca6-a08678785dd5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.096629 Sep 01 08:28:07.530600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1637/3299] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:07 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:07.630911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:07.631510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:07.637756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.638371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.638853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.639636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:07.640153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:07.640619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:07.711181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:07.719394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9dc6646-ac12-48e4-96c2-9af5948b4ff5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.092274 Sep 01 08:28:07.720580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1663/3300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:07 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:08.109464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:08.110076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:08.116213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.116688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.117114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.117797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.118286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.118711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.150526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:08.151121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:08.157408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.158173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.158337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.159023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.159467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.159888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.183596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:08.192624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:08.194138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:08.195282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4881250b-3092-4d18-9b3b-2274a65e29e8 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.089835 Sep 01 08:28:08.195840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1638/3301] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:08 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:08.228139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:08.236960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d98192af-e6c1-4905-9894-361e16ea27f2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.092020 Sep 01 08:28:08.237546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1664/3302] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:08 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:08.339571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:08.340170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:08.346151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.346655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.347103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.347789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.348228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.348642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.410601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:08.419431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0b9e0271-3aac-48b5-b895-5cfa68034b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.083639 Sep 01 08:28:08.420000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1639/3303] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:08 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:08.561873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:08.562503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:08.569387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.569895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.570418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.571178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.571697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.572173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.638194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:08.650035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f046a024-59d8-43d9-b12d-a22f7333605d tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091921 Sep 01 08:28:08.650666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1665/3304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:08 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:08.742072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:08.742661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:08.748957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.749436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.749862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.750581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:08.751033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:08.751595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:08.818503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:08.826448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-38b976c5-3ad5-4091-97a5-1e04d6974c86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088215 Sep 01 08:28:08.827017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1640/3305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:08 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:09.219292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:09.219939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:09.225915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.226495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.226924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.227609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.228051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.228459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.258438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:09.259355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:09.265701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.266181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.266770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.267876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.268343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.268899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.300812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:09.309971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:09.311436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:09.312707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95131eb4-0118-4a3f-aa44-fb45249d83c9 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.097168 Sep 01 08:28:09.313125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1666/3306] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:09 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:09.333383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:09.341200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cac7581a-cea1-4061-b161-3e378f47d247 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086552 Sep 01 08:28:09.341762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1641/3307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:09 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:09.440936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:09.441542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:09.447599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.448075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.448505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.449193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.449638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.450056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.529195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:09.539080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea5859d9-3377-456c-ab0c-0aabf22bb03e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.102442 Sep 01 08:28:09.539722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1667/3308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:09 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:09.671215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:09.671811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:09.678436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.678922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.679353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.680035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.680480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.680893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.745032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:09.759373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c12a368-83b1-43c1-9253-2d4b5f98c3c3 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091807 Sep 01 08:28:09.759962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1642/3309] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:09 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:09.849482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:09.850146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:09.856967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.857454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.857885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.858911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:09.859418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:09.859886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:09.927756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:09.935569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf1b61c9-33c0-4576-94bd-0b026e6b5135 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090232 Sep 01 08:28:09.936150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1668/3310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:09 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:10.336390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:10.337039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:10.343236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.343722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.344154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.345429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.345864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.346305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.362844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:10.362844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:10.369245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.369735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.370168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.370900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.371888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.371888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.424306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:10.432831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:10.434290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:10.435405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8987b7c8-a22b-4b4d-ab17-a74e757f9d7f tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.103241 Sep 01 08:28:10.435978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1643/3311] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:10 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:10.453500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:10.461971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-082838de-f479-46cc-ac66-ed7dca320615 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.104512 Sep 01 08:28:10.462571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1669/3312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:10 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:10.560875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:10.561481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:10.567594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.568075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.568508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.569196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.569642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.570064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.634344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:10.643150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3b3610bb-6010-48b4-b654-dfcc97d6a419 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085931 Sep 01 08:28:10.643742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1644/3313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:10 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:10.780009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:10.780604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:10.787424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.787981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.788446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.789179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.789667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.790123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.863534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:10.871425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eac41c9d-7e4b-46a2-ac10-7b364fc654fc tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095223 Sep 01 08:28:10.872003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1670/3314] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:10 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:10.958676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:10.959286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:10.965964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.966492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.966929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:10.967639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:10.968097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:10.968526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.033521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:11.041543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b1360b6-3854-456a-85e7-21912c6d57b3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087688 Sep 01 08:28:11.042121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1645/3315] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:10 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:11.459739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:11.460388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:11.466810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.467315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.467742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.468451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.468905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.469331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.490306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:11.491045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:11.501485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.502417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.503229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.504447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.505261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.506014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.535967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:11.544325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:11.545749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:11.546886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bedb94d6-1792-4866-83e4-22719d6d3d5a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.091764 Sep 01 08:28:11.547434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1671/3316] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:11 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:11.574522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:11.584223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-07ce4dbc-f9f9-472f-b566-9f968e1f2f29 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100755 Sep 01 08:28:11.584809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1646/3317] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:11 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:11.664883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:11.665516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:11.671586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.672066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.672507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.673253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.673753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.674183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.742803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:11.750623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7551d3d0-acb1-4f27-aebe-c10e09ddc565 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.089541 Sep 01 08:28:11.751750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1672/3318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:11 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:11.894126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:11.894803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:11.900946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.901550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.901978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.902700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:11.903145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:11.903568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:11.972059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:11.980710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28ef78cd-fda7-40bf-82a0-91d19950f78b tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.091517 Sep 01 08:28:11.981389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1647/3319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:11 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:12.062820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:12.063961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:12.071128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.071607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.072037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.072731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.073169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.073587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.136132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:12.144546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ede42e0-b8bc-48ba-833c-7da7269e74ab tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085540 Sep 01 08:28:12.145119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1673/3320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:12 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:12.568684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:12.569309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:12.578772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.579360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.580093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.580802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.581249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.581670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.607226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:12.607860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:12.614897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.615378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.615801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.616489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.616930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.617345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.636411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:12.672275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:12.679864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:12.681321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:12.682464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9951eed3-c39f-401b-8168-a6478e1baa4c tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.117706 Sep 01 08:28:12.683027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1648/3321] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:12 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:12.709091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:12.717964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8b184123-b679-4908-8005-abb2821aede2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.114655 Sep 01 08:28:12.718763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1674/3322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:12 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:12.775071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:12.775588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:12.781859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.782936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.783383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.784075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:12.784516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:12.785026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:12.854424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:12.865535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-859c2c0a-115d-4c9f-82f9-28583db42d29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094136 Sep 01 08:28:12.866392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1649/3323] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:12 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:13.001515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:13.002124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:13.011690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.012173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.012606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.013296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.013749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.014166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.078424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:13.087673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0dd1692-ff3e-48b4-b823-c0230f993dfe tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090061 Sep 01 08:28:13.088265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1675/3324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:12 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:13.165334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:13.165967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:13.172130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.172614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.173999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.174839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.175333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.176058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.241352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:13.249243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3c0d0424-9aeb-4a5a-a639-bfa92dfc9c07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087795 Sep 01 08:28:13.249810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1650/3325] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:13 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:13.706017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:13.707509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:13.713575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.714054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.714521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.715206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.715648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.716063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.740958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:13.741873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:13.750380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.750871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.751347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.752138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.752653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.753017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.769411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:13.781641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:13.791368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:13.792805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:13.793904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3414df0d-40d6-4374-9ad1-01fac2b1d261 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092375 Sep 01 08:28:13.794495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1676/3326] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:13 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:13.818008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:13.825897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d32bdec9-2adb-439a-937e-821ab7b64b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090999 Sep 01 08:28:13.826500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1651/3327] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:13 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:13.889562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:13.890161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:13.896914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.897385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.897810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.898523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:13.898967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:13.899384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:13.963023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:13.972308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ff682fcd-f9bf-4b5b-aaf7-21c91da94bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087154 Sep 01 08:28:13.972971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1677/3328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:13 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:14.109396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:14.110001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:14.117574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.118073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.118541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.119242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.119697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.120119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.185161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:14.194093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6f6a40f0-1498-4493-b739-894c3d54d48a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.088520 Sep 01 08:28:14.194706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1652/3329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:14 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:14.269184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:14.269784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:14.276118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.276604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.277034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.277732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.278173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.278767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.346634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:14.354535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d038096e-166b-419a-b34a-fc4ab1055887 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089251 Sep 01 08:28:14.355103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1678/3330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:14 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:14.817664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:14.818293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:14.824447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.824929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.825374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.826082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.826540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.826961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.846794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:14.847470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:14.854041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.854571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.855001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.855711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:14.856342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:14.856802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:14.893673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:14.902586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:14.904037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:14.905155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4f83c86c-7c83-40c3-97ae-b0a23f21edb7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.092301 Sep 01 08:28:14.905713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1653/3331] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:14 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:14.923768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:14.931443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7f4ef5cb-122d-4837-80bf-8e81587bc34e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088408 Sep 01 08:28:14.932016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1679/3332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:14 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:14.993054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:14.993658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:14.999793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.000273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.000701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.002033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.002506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.002939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.067462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:15.077178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-339b050d-9e87-4b67-a464-51c742479a39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087587 Sep 01 08:28:15.077499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1654/3333] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:14 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:15.215781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:15.216420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:15.223348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.223841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.224282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.225005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.225451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.225882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.293777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:15.302098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0f544670-92f6-4ea6-9c77-ed262e05d319 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090092 Sep 01 08:28:15.302716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1680/3334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:15 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:15.376835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:15.377372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:15.384100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.384584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.385014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.385799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.386280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.386723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.453910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:15.463720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4555e062-bbe0-45ef-9cf6-28ce2ee27f5a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091289 Sep 01 08:28:15.465009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1655/3335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:15 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:15.928006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:15.928918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:15.935652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.936137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.936569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.937265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.937713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.938135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.953223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:15.953820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:15.960282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.960771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.961203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:15.962069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:15.962578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:15.963023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:16.009893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:16.018388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:16.019842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:16.020971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44699429-4232-4fde-b7d0-6009a6745dd5 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096920 Sep 01 08:28:16.021539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1681/3336] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:15 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:16.029447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:16.038210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-003848a9-a7a9-444a-9b53-cbe6b5db0f82 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088820 Sep 01 08:28:16.039111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1656/3337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:15 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:16.102640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:16.103376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:16.109639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:16.110112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:16.110569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:16.111466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:16.112131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:16.112547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:16.175572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:16.183406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-571bfa53-e710-4c7a-b36e-346254c8a3d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084416 Sep 01 08:28:16.183913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1682/3338] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:16 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:16.323423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:16.324031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:16.330362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:16.330853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:16.331294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:16.332261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:16.332785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:16.333196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:16.433535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:16.441860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70f64efb-aeb1-46a4-922c-148ba3457d50 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.122251 Sep 01 08:28:16.442479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1657/3339] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:16 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:16.491419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:16.492186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:16.498710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:16.499190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:16.499620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:16.500308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:16.500753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:16.501380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:16.570354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:16.583197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f25da1f1-52c2-4abf-8de6-420e9ef8b88f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.095299 Sep 01 08:28:16.584246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1683/3340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:16 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:17.044365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:17.045016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:17.051261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.051742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.052178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.052865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.053308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.053734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.060572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:17.061338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:17.068170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.068630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.069063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.069764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.070209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.070651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.127263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:17.135863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:17.137306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:17.138451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-667dae9b-9bbb-4a05-ba83-cc75314dcb66 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.097969 Sep 01 08:28:17.139011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1658/3341] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:17 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:17.148882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:17.158033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-129b0cd0-77d8-44bf-84c4-378d52690578 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100790 Sep 01 08:28:17.158640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1684/3342] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:17 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:17.204568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:17.205308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:17.211925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.212402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.212832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.213524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.213971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.214431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.279218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:17.287938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d785069b-f63d-4967-935c-cb8a13c25cb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.087188 Sep 01 08:28:17.288631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1659/3343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:17 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:17.464587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:17.465105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:17.473516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.473925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.474393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.475099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.475557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.475983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.539347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:17.548571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6ce4b22-cd5b-4e39-916c-eaf9b60f2f9a tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087115 Sep 01 08:28:17.549168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1685/3344] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:17 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:17.604141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:17.604762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:17.611290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.611766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.612204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.612906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:17.613351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:17.613791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:17.674770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:17.682167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2eb7ef26-eb74-406a-b220-bb587c839f25 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081914 Sep 01 08:28:17.682758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1660/3345] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:17 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:18.167391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:18.168010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:18.174737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.175210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.175639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.176315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.176754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.177287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.179324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:18.179923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:18.185798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.186285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.186740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.187446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.187888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.188326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.251683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:18.259823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:18.261239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:18.262342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e4e35e08-a44b-42fe-865e-15bd233e9887 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.098943 Sep 01 08:28:18.262903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1686/3346] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:18 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:18.266932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:18.274450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3006e343-eaa1-4aa6-8226-262783c4c3f6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.099245 Sep 01 08:28:18.275003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1661/3347] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:18 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:18.308702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:18.309308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:18.311116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:18.316967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.317447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.317882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.318596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.319044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.319463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.381981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:18.389514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-baaf7312-ed8e-4019-9053-76a60d6d489c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.084589 Sep 01 08:28:18.390076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1687/3348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:18 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:18.570345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:18.570962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:18.580509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.581128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.581784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.583051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.583615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.584045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.650252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:18.662184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ac2e4dad-9a95-474e-aad9-644f21ea8150 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.095748 Sep 01 08:28:18.662801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1662/3349] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:18 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:18.703281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:18.704031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:18.711124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.711719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.712232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.713010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:18.713532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:18.714022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:18.779796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:18.788361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bc710bb6-4e1f-4a50-b8ce-223362ba9923 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088979 Sep 01 08:28:18.788923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1688/3350] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:18 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:19.293361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:19.293968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:19.294374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:19.294481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:19.301300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.301859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.304062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.306238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.306520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.306681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.306839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.306993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.306993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.307177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.307177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.307177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.382942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:19.395358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:19.397285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:19.398475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7ca7c91c-16d4-4dd7-8c5b-ea75071b6862 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.109017 Sep 01 08:28:19.398984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:19.399144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1663/3351] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:19 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:19.409030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ada6af10-d621-492c-8811-3e4d60603b49 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.118978 Sep 01 08:28:19.409709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1689/3352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:19 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:19.414606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:19.415661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:19.423024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.424047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.428217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.429327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.430906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.430906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.496168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:19.505219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e61d8f31-d11c-468c-8b85-b67ef5dc6d4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.096946 Sep 01 08:28:19.505949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1664/3353] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:19 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:19.684200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:19.684718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:19.692715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.693201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.693666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.694380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.694829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.695370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.756880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:19.764428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9e2429d2-5fe2-4a9d-b032-947aa493b2c2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.084239 Sep 01 08:28:19.764996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1690/3354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:19 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:19.809679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:19.810297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:19.817018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.817499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.817928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.818652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:19.819186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:19.819611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:19.880684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:19.888232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb75a024-94fa-4dbb-8dda-ffb2d799b13b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082400 Sep 01 08:28:19.888791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1665/3355] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:19 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:20.422870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:20.423463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:20.429839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.430159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:20.430712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.430852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.430950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:20.431447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.431895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.432318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.432815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:20.437255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:20.447366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.447852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.448359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.448970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.449588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.450009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.501270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:20.509738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:20.511208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:20.512324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7efd409f-cdfc-4b17-ad5a-907da05fe5ac tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.093327 Sep 01 08:28:20.512897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1691/3356] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:20 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:20.529743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:20.530437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:20.530833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:20.537751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.538286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.538739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.539222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7907c88f-a303-4814-b959-a70e65a996b6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.112889 Sep 01 08:28:20.539439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.539808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1666/3357] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:20 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:20.539960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.540290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.608630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:20.618036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7cd1b4f-1d31-4e87-a27e-87a65aab43ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094246 Sep 01 08:28:20.618765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1692/3358] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:20 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:20.785516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:20.786183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:20.793017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.793592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.794030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.794768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.795220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.795649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.858960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:20.861735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:20.869068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5014a64f-54ab-4e32-88d7-4dd2fc168dd2 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.087914 Sep 01 08:28:20.869742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1667/3359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:20 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:20.909797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:20.910435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:20.916636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.917114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.917557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.918495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:20.919041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:20.919558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:20.991207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:20.998874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3fce8a95-48b0-457e-8db4-487ffcd6f7ef tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.093693 Sep 01 08:28:20.999444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1693/3360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:20 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:21.541691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:21.542333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:21.550953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.551528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.552050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.552704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.553151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.553572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.560399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:21.561152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:21.567646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.568128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.568579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.569258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.569705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.570125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.628527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:21.639859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:21.641365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:21.643366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a83939a6-0e47-482a-bd0d-f829b4e970c7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.111699 Sep 01 08:28:21.644003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1668/3361] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:21 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 08:28:21.648545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:21.649155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:21.649581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:21.655368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.655837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.656385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.656971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.658318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e3d62813-3219-4219-95aa-3f85045a2798 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.101639 Sep 01 08:28:21.658695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.659111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1694/3362] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:21 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:21.659251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.730367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:21.738813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6dae8176-fd5a-4048-97d7-538a371d922e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.093808 Sep 01 08:28:21.739416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1669/3363] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:21 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:21.895023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:21.895626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:21.902099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.902612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.903043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.903725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:21.904165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:21.904585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:21.968274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:21.976352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5bce7218-4665-4bb9-97d2-1319d98585aa tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.085411 Sep 01 08:28:21.977011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1695/3364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:21 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:22.019231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:22.019759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:22.026135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.026661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.027096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.027811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.028259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.028683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.097216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:22.105306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-74b01a03-07a2-427b-b6ed-940bfee2a9ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090293 Sep 01 08:28:22.105882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1670/3365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:22 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:22.666367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:22.667098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:22.673149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.673638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.674054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.674818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.675262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.675680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.678851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:22.679468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:22.685527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.686009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.686480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.687179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.687627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.688045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.750137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:22.760205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:22.761656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:22.763016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61b0a791-8cc7-4c13-9463-cbfbe7bf9073 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.100461 Sep 01 08:28:22.763407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1696/3366] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:22 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:22.765311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:22.768502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:22.769009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:22.774852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-395f98d9-06dd-4742-a247-fb2ff87ae1b3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.099659 Sep 01 08:28:22.775114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.775494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.775942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.776638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:22.777090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:22.777516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:22.777916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1671/3367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:22 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:22.841778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:22.850762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3298fd70-7c20-4097-9821-551babb840d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.086322 Sep 01 08:28:22.851338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1697/3368] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:22 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:22.997097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:22.997761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:23.005586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.006074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.006560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.007259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.007716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.008173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.081667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:23.089711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e035d92-dde8-4a95-b320-953b4572c111 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.096541 Sep 01 08:28:23.090306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1672/3369] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:22 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:23.127363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:23.127999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:23.134223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.134736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.135162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.135853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.136295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.136707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.200954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:23.209816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-83e6f18e-4357-424f-878d-861bbe35d0c3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086291 Sep 01 08:28:23.210467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1698/3370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:23 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:23.786648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:23.787279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:23.794573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.795085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.795528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.796263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.796723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.797149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.800036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:23.800820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:23.808786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.809370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.809812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.810581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.811052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.811458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.871524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:23.880590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:23.882032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:23.887504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed462aad-743b-415f-92c1-7e5fb7eb6c39 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.101464 Sep 01 08:28:23.888141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1673/3371] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:23 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:23.896967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:23.897648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:23.901102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:23.903726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.904438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.904642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.905344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:23.905795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:23.906217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:23.911571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38c3da17-612c-4165-af31-e1229be777fc tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.117976 Sep 01 08:28:23.912370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1699/3372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:23 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:23.972728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:23.980447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e6c81b99-e4c8-44d6-99a7-12e17e67c933 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.091341 Sep 01 08:28:23.980998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1674/3373] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:23 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:24.112626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:24.113227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:24.119196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.119674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.120103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.120785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.121229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.121649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.183148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:24.191235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4c1bafc0-7565-40ff-8417-21c08f8ece68 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.083359 Sep 01 08:28:24.191804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1700/3374] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:24 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:24.231461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:24.232057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:24.239151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.239640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.240080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.240782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.241258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.241682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.303644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:24.311506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5eee16cd-fb86-4078-815d-a7e80e8afa9e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083818 Sep 01 08:28:24.312080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1675/3375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:24 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:24.912178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:24.912783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:24.920092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.920875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.921631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.922563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.923024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.923452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.933017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:24.933611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:24.940084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.940568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.940999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.942026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:24.942518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:24.943017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:24.995566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:25.006776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:25.010567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:25.012610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21c18849-ac4e-4639-8544-c11ed3537faa tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.104927 Sep 01 08:28:25.013580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1701/3376] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:24 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:25.024264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:25.025916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:25.039619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:25.040947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:25.041589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:25.042521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:25.043099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:25.043557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:25.043783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:25.053279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4094a0c3-1f16-47c7-b13d-09737bcf6913 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.123934 Sep 01 08:28:25.054074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1676/3377] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:24 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:25.112588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:25.121396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-551a4cd1-b469-4425-8e2d-c45353a335a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.106335 Sep 01 08:28:25.121976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1702/3378] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:25 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:25.212411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:25.212905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:25.221692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:25.222396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:25.222946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:25.225508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:25.226004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:25.226447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:25.307963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:25.318454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0d3df04a-07bc-4f76-8f67-baefe280c661 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.109843 Sep 01 08:28:25.319039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1677/3379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:25 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:25.333745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:25.334691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:25.343940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:25.344815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:25.345820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:25.346932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:25.347439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:25.347865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:25.419683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:25.435582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f8a3ef82-e10b-4c46-b054-9b2138b4b267 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.106012 Sep 01 08:28:25.437164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1703/3380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:25 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:26.041521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:26.042102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:26.048091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.048573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.049012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.049699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.050146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.050593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.074801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:26.075454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:26.082401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.082879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.083303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.083993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.084439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.084852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.122789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:26.131641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:26.133098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:26.134204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e00a5465-6380-4659-94f5-c768afaa06da tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.096787 Sep 01 08:28:26.134983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1678/3381] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:26 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:26.150739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:26.151343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:26.151556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:26.157684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.160228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16938fce-624b-498f-94ec-ba2f637baadf tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.089147 Sep 01 08:28:26.161061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1704/3382] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:26 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:26.162847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.163327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.164035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.164480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.164895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.226867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:26.234436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a7b06fa-fdc9-4c7f-bd37-1afec1e32a98 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090069 Sep 01 08:28:26.234995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1679/3383] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:26 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:26.341741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:26.342301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:26.349410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.349900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.350366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.351058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.351506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.351924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.412148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:26.419735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-344757ce-8a15-4462-98f0-018cbcc15990 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.081833 Sep 01 08:28:26.420300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1705/3384] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:26 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:26.459167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:26.459780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:26.465852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.466373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.466816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.467516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:26.467967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:26.468393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:26.532833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:26.541420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6abc9174-f348-479e-892e-0b31f565c37e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087113 Sep 01 08:28:26.542000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1680/3385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:26 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:27.156590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:27.157315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:27.165164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.165760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.166219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.167008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.167462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.167895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.182209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:27.183061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:27.189038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.190073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.190524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.191216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.191660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.192083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.243455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:27.252951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:27.254403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:27.255531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c59e5eb-f572-4065-b2ab-4127fe4d9562 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.102876 Sep 01 08:28:27.256083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1706/3386] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:27 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:27.260425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:27.261018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:27.268276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.268761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.269194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.269575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:27.269880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.270359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.270785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.277509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b6edbd0a-bb0e-462f-888b-cac9711bb5a5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100161 Sep 01 08:28:27.278161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1681/3387] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:27 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:27.334146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:27.337474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:27.342542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-48636c66-bc57-43c5-b7b9-b50e615a0501 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.085496 Sep 01 08:28:27.343104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1707/3388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:27 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:27.440735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:27.441358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:27.447341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.447813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.448241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.448916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.449357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.449773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.508865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:27.516351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-021d892b-3555-4d55-b542-7b3b9890b054 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.080287 Sep 01 08:28:27.516908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1682/3389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:27 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:27.562919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:27.563517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:27.570363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.570842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.572747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.572747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:27.572747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:27.573074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:27.637529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:27.647576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-62dbecb9-4af1-45cf-9565-7bbe9af48c56 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089008 Sep 01 08:28:27.648159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1708/3390] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:27 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:28.279001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:28.279663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:28.286878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.287371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.287810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.288510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.288963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.289393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.301709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:28.302388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:28.312583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.312583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.313285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.313539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.317610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.317610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.375522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:28.385567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:28.387224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:28.388339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fc44789f-a0de-4dc1-b155-5a779e5e8215 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.113368 Sep 01 08:28:28.388892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1683/3391] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:28 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:28.394511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:28.395133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:28.397318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:28.402552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.403053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.403659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.404361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.404817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.405233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.405722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c3fc187c-d34f-41e7-840b-e1e8059c3dfd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.109683 Sep 01 08:28:28.406583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1709/3392] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:28 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:28.422687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:28.471948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:28.480692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d40c6a72-fc59-4b38-bcb9-ce7e13fe28c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.090790 Sep 01 08:28:28.481272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1684/3393] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:28 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:28.538125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:28.538693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:28.544803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.545280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.545707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.546434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.546879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.547293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.617298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:28.625038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16bae180-50e4-4917-8cef-c9c9b774bce8 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090755 Sep 01 08:28:28.625615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1710/3394] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:28 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:28.674034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:28.674667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:28.680919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.681400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.681858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.682581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:28.683020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:28.683435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:28.750970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:28.759366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d27ef96e-a473-4337-b92b-02e60715a116 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089123 Sep 01 08:28:28.759933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1685/3395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:28 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:29.414756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:29.415401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:29.421726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.422396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.422989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.424380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.424845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.425325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.427728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:29.428479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:29.434561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.435043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.435480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.436182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.436659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.442001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.542522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:29.544312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:29.551892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48c9fe23-69a7-4996-815d-638f379fb29c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.128649 Sep 01 08:28:29.552541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1686/3396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:29 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:29.570574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:29.570574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:29.570574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4dc30ae0-b30c-40f5-84f4-175f9cb61ce0 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.144926 Sep 01 08:28:29.571191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1711/3397] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:29 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:29.571366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:29.571366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:29.571366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.571366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.572030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.572030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.572030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.572030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.639385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:29.646096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:29.646900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:29.648292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-60945673-feaf-4062-a1c0-e18ac2f3ebb6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.094612 Sep 01 08:28:29.648870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1687/3398] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:29 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:29.653003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.653485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.653914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.654631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.655078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.655497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.722663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf3d36d40d442019e09a3e4c32b8330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e0d80b70984b39a3a4c07d0018f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:29.732399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-88878922-7320-49ce-ae77-b5c2d598a191 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 200 len: 1240 microversion: 2.1 time: 0.090960 Sep 01 08:28:29.733217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1712/3399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:29 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:29.756043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:29.756402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:29.764272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.764272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.764665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.765247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.765895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.766463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.781499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:29.782298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:29.788911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.789392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.789820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.790698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.791154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.791573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.795456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:28:29.807430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:29.807913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:29.808416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:29.823733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lazy-loading 'flavor' on Instance uuid 94bc4d39-2263-48c4-9018-de8b4cabb195 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:29.838700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lazy-loading 'system_metadata' on Instance uuid 94bc4d39-2263-48c4-9018-de8b4cabb195 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:29.859594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:29.863739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lazy-loading 'metadata' on Instance uuid 94bc4d39-2263-48c4-9018-de8b4cabb195 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:29.869189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a54595d9-d1c2-48ae-86ce-843a1bd75920 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091540 Sep 01 08:28:29.869790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1713/3400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:29 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:30.111564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Deleted allocations for instance 94bc4d39-2263-48c4-9018-de8b4cabb195 Sep 01 08:28:30.129279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bc8047d4-4590-4232-b485-947c0538604f tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 204 len: 0 microversion: 2.1 time: 0.377808 Sep 01 08:28:30.129881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1688/3401] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:28:29 2022] DELETE /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:28:30.138708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:30.139314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] [instance: 94bc4d39-2263-48c4-9018-de8b4cabb195] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:30.146300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.146779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.147203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.147890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.148331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.148745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.163656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] HTTP exception thrown: Instance 94bc4d39-2263-48c4-9018-de8b4cabb195 could not be found. Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Request method failure captured: Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 HTTP/1.1 Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGpKurIpoyXX1XPjScUxBVPhYWGWYPUuA8zNKx5fWxgkUKBCLNP5rnCHu0KmQpkf99clcZE52xYHX4FtfRk-mLLfy5W7s9J9-7sw_vIcinHvQblLzukzh_yidz45Ny0eXajXFaP0mq299K_XiAn_73ReY6SAdUKBHeEDaoH6kRDdOc8 Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: b2e0d80b70984b39a3a4c07d0018f67b Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-AttachVolumeTestJSON-177408922 Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:28:30.165182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e0d80b70984b39a3a4c07d0018f67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e0d80b70984b39a3a4c07d0018f67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2e0d80b70984b39a3a4c07d0018f67b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2e0d80b70984b39a3a4c07d0018f67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-AttachVolumeTestJSON-177408922 Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: b2e0d80b70984b39a3a4c07d0018f67b Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-177408922 Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-AttachVolumeTestJSON-177408922-project Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: eaf3d36d40d442019e09a3e4c32b8330 Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-AttachVolumeTestJSON-177408922-project Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance 94bc4d39-2263-48c4-9018-de8b4cabb195 could not be found. Sep 01 08:28:30.166757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '94bc4d39-2263-48c4-9018-de8b4cabb195'} Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bc4d39-2263-48c4-9018-de8b4cabb195 could not be found. Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:28:30.167573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bc4d39-2263-48c4-9018-de8b4cabb195 could not be found. Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bc4d39-2263-48c4-9018-de8b4cabb195 could not be found. Sep 01 08:28:30.169159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:30.170656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Returning 404 to user: Instance 94bc4d39-2263-48c4-9018-de8b4cabb195 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:28:30.170656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db16724c-6eca-4829-b836-7b958586ff63 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195" status: 404 len: 111 microversion: 2.1 time: 0.032449 Sep 01 08:28:30.170656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1714/3402] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:30 2022] GET /compute/v2.1/servers/94bc4d39-2263-48c4-9018-de8b4cabb195 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:28:30.176582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-51c19a0f-7d8e-4d77-b7b5-a1982ac60ce5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] Calling method '.version_select at 0x7f2ac29aa9d0>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:30.196962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-51c19a0f-7d8e-4d77-b7b5-a1982ac60ce5 tempest-AttachVolumeTestJSON-177408922 tempest-AttachVolumeTestJSON-177408922-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497273491" status: 202 len: 0 microversion: 2.1 time: 0.024457 Sep 01 08:28:30.197528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1689/3403] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Sep 1 08:28:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497273491 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 08:28:30.578918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:30.579540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:30.586476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:30.587087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.587186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.587280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:30.587591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.588444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.589420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.589792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.594189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.594711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.595866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.596767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.597244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.597665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.736845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:30.738193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:30.745712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f8332c29-2cd7-4ead-a4b7-d0ba314a6fa9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.164121 Sep 01 08:28:30.746521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1690/3404] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:30 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:30.747234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:30.748545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7559a0b8d46b4524b40f68b992f6cfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631e2e8467654c0ea799bf50fed7afad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:30.749636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2c9213f2-61af-4def-952b-5d380d55985a tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 200 len: 1284 microversion: 2.20 time: 0.175010 Sep 01 08:28:30.750330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1715/3405] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:30 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 1284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 08:28:30.763839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:30.764447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:30.770787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:30.771278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:30.771401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.771869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.772382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.773155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.773673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.774182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.777360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.777833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.779490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.779490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.779490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.779779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.806575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:28:30.815947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.816551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.816981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.830487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lazy-loading 'flavor' on Instance uuid 9b6e151f-efd6-401a-9b2c-3703942f0b16 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:30.843294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lazy-loading 'system_metadata' on Instance uuid 9b6e151f-efd6-401a-9b2c-3703942f0b16 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:30.860793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:30.862883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lazy-loading 'metadata' on Instance uuid 9b6e151f-efd6-401a-9b2c-3703942f0b16 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:30.869409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-39ca3dba-7c8e-4e39-87c2-990e0819a2f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.109362 Sep 01 08:28:30.869979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1691/3406] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:30 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:30.892609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:30.893971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:30.901343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.901838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.902303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.903014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:30.903458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:30.904137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:30.990813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:31.000009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cda8ff92-b783-4811-bcf7-cb93e9f9eecf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.111479 Sep 01 08:28:31.012155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1692/3407] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:30 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:31.086244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Deleted allocations for instance 9b6e151f-efd6-401a-9b2c-3703942f0b16 Sep 01 08:28:31.107450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9509de8-ecb0-472e-ac97-056f6698fc43 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 204 len: 0 microversion: 2.20 time: 0.340505 Sep 01 08:28:31.108341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1716/3408] 10.222.0.43 () {60 vars in 1280 bytes} [Thu Sep 1 08:28:30 2022] DELETE /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 08:28:31.120776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:31.121445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] [instance: 9b6e151f-efd6-401a-9b2c-3703942f0b16] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:31.128235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:31.128707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:31.129136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:31.129829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:31.130246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:31.130682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:31.144759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] HTTP exception thrown: Instance 9b6e151f-efd6-401a-9b2c-3703942f0b16 could not be found. Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Request method failure captured: Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 HTTP/1.1 Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGpN5wB9uS7zrQ96OeXlTYHObcBEvaEn7SObCULdxAm5J4DIkSV3apHXHXJ-buzACnuSMoimhJqbOzBfEphicKKgzDCTBeGYSQmUeakI03qAfxRQKEZzzhycMxOQsG51EHo9hb0c5_ByejPvAL7lTwCPW367wMZ4aDWK9K4m0-MgE3w Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: 631e2e8467654c0ea799bf50fed7afad Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064350163 Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:28:31.146482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/631e2e8467654c0ea799bf50fed7afad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/631e2e8467654c0ea799bf50fed7afad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_631e2e8467654c0ea799bf50fed7afad", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/631e2e8467654c0ea799bf50fed7afad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064350163 Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: 631e2e8467654c0ea799bf50fed7afad Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064350163 Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-AttachVolumeShelveTestJSON-2064350163-project Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: 7559a0b8d46b4524b40f68b992f6cfe9 Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064350163-project Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance 9b6e151f-efd6-401a-9b2c-3703942f0b16 could not be found. Sep 01 08:28:31.148077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '9b6e151f-efd6-401a-9b2c-3703942f0b16'} Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b6e151f-efd6-401a-9b2c-3703942f0b16 could not be found. Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:28:31.148934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b6e151f-efd6-401a-9b2c-3703942f0b16 could not be found. Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b6e151f-efd6-401a-9b2c-3703942f0b16 could not be found. Sep 01 08:28:31.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:28:31.153012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Returning 404 to user: Instance 9b6e151f-efd6-401a-9b2c-3703942f0b16 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:28:31.153012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-36222910-8190-4ade-8440-26bbe46600d7 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16" status: 404 len: 111 microversion: 2.20 time: 0.033659 Sep 01 08:28:31.153012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1693/3409] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Sep 1 08:28:31 2022] GET /compute/v2.1/servers/9b6e151f-efd6-401a-9b2c-3703942f0b16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 08:28:31.159330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7fe0d6e-cd77-4bdf-8dfc-36c7ea3f7787 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] Calling method '.version_select at 0x7f2ac2b1a550>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:31.184666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7fe0d6e-cd77-4bdf-8dfc-36c7ea3f7787 tempest-AttachVolumeShelveTestJSON-2064350163 tempest-AttachVolumeShelveTestJSON-2064350163-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734768784" status: 204 len: 0 microversion: 2.20 time: 0.029104 Sep 01 08:28:31.186516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1717/3410] 10.222.0.43 () {60 vars in 1259 bytes} [Thu Sep 1 08:28:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734768784 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 08:28:31.767568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:31.768311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:31.774555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:31.775133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:31.775626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:31.776394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:31.776919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:31.777492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:31.848117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:31.857357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-37fcaaeb-b81a-4166-8269-f7ca27386aae tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.094250 Sep 01 08:28:31.858088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1694/3411] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:31 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:31.890756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:31.893296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:31.901075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:31.901905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:31.902592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:31.903574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:31.904018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:31.904690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:31.974098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:31.982923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-04f4df62-5edf-473b-ac1c-b7d280a73eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.096056 Sep 01 08:28:31.983492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1718/3412] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:31 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:32.024671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:32.025316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:32.031681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:32.032168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:32.032860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:32.033575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:32.034029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:32.034482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:32.118822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:32.128285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-052800e3-74c7-41f6-b027-d0a7b91cab54 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.107499 Sep 01 08:28:32.129192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1695/3413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:32 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:32.881622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:32.883179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:32.891680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:32.894137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:32.894897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:32.896149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:32.896882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:32.897576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.005931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:33.006642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:33.016617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.018125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.023602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.024915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.026467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.027160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.051397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:33.075037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-575fb32e-ba12-4c45-bef0-9fc2b2c1a142 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.197464 Sep 01 08:28:33.078536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1719/3414] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:32 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:33.149645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:33.150718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:33.157303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.158928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.159807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.160850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.161782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.162476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.192958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:33.202384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-27449a4d-ff2f-40da-b4d7-506e178ff29a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 200 len: 1246 microversion: 2.1 time: 0.201564 Sep 01 08:28:33.218183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1696/3415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:32 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 1246 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:33.224595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:33.225520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:33.232136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.232999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.233685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.234714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.235432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.236173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.286745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:28:33.302030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.303122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.308227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.326563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:33.336665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'flavor' on Instance uuid 21e930b0-ae90-4e58-b029-32fc8e03de90 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:33.343018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6cbca2a-4e58-4843-8079-22fe83263ca5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.197057 Sep 01 08:28:33.343935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1720/3416] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:33 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:33.370648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'system_metadata' on Instance uuid 21e930b0-ae90-4e58-b029-32fc8e03de90 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:33.379192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:33.400687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'metadata' on Instance uuid 21e930b0-ae90-4e58-b029-32fc8e03de90 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:28:33.631307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Deleted allocations for instance 21e930b0-ae90-4e58-b029-32fc8e03de90 Sep 01 08:28:33.655136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e362dc9-933c-4c2a-8bec-81fe44db238e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "DELETE /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 204 len: 0 microversion: 2.1 time: 0.434699 Sep 01 08:28:33.656388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1697/3417] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:28:33 2022] DELETE /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:28:33.667000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:33.667767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 21e930b0-ae90-4e58-b029-32fc8e03de90] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:33.675667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.676249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.676947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.677733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:33.678314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:33.678815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:33.697499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] HTTP exception thrown: Instance 21e930b0-ae90-4e58-b029-32fc8e03de90 could not be found. Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Request method failure captured: Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 HTTP/1.1 Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGvESDAEazsCEeCNcxG06A9K3it5r5eEzs0PvD93A7hjcqTHrlXbhK0f6m8Pd4m2YKHFzAfnzyGoSxRwwwSnsuTaLrGfBnNxX4I0AbMKiVHhtmL42A-Xvraj7YgIJiKoEJYG4Nr2y6nKk0P2U3418Jhl7f3hMOzSeqXyE6zXI_9tu5U Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: e8088d87969e46a2b2cc69dd7297ae14 Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:28:33.699241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e8088d87969e46a2b2cc69dd7297ae14", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: e8088d87969e46a2b2cc69dd7297ae14 Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-AttachVolumeNegativeTest-2002778612-project Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: ccd2c619e9fc436ea01a1200bc46b60f Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-AttachVolumeNegativeTest-2002778612-project Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance 21e930b0-ae90-4e58-b029-32fc8e03de90 could not be found. Sep 01 08:28:33.700723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '21e930b0-ae90-4e58-b029-32fc8e03de90'} Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e930b0-ae90-4e58-b029-32fc8e03de90 could not be found. Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:28:33.701565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e930b0-ae90-4e58-b029-32fc8e03de90 could not be found. Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e930b0-ae90-4e58-b029-32fc8e03de90 could not be found. Sep 01 08:28:33.702903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:28:33.704099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Returning 404 to user: Instance 21e930b0-ae90-4e58-b029-32fc8e03de90 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:28:33.704099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d0460280-2b9a-4e9c-baef-aaebc7f136f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90" status: 404 len: 111 microversion: 2.1 time: 0.039316 Sep 01 08:28:33.704099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1721/3418] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:33 2022] GET /compute/v2.1/servers/21e930b0-ae90-4e58-b029-32fc8e03de90 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 08:28:33.711222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0417e759-bdf2-43d9-8c9c-06a2965b5eea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '.version_select at 0x7f2abf0daf70>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:33.741006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0417e759-bdf2-43d9-8c9c-06a2965b5eea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648294146" status: 202 len: 0 microversion: 2.1 time: 0.031316 Sep 01 08:28:33.741894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1698/3419] 10.222.0.43 () {58 vars in 1221 bytes} [Thu Sep 1 08:28:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648294146 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 08:28:34.123144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:34.123763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:34.130073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:34.130591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:34.131103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:34.132033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:34.132597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:34.133282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:34.218169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:34.222478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:34.235736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c1b67527-dc24-4efb-ab4d-4adad97a24bb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.117644 Sep 01 08:28:34.237796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1722/3420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:34 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:34.377884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:34.379888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:34.391992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:34.395477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:34.406185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:34.412124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:34.415835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:34.417430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:34.677878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:34.696309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1d59775-bb8a-485f-8931-2a9f66c3d25f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.327293 Sep 01 08:28:34.698239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1699/3421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:34 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:35.247288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-971626e0-5c2d-4961-a85c-4853aa1a84f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Action: 'create', calling method: .version_select at 0x7f2ac2ab8820>, body: {"keypair": {"name": "tempest-keypair-974400570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnsAOzWpz8aJzwtikN3IFrMHewuqiiKC3e6rS105RITFtwDOKYMPzhhUvVC6l0yjm19U1oQqYLngvViyh37pr6zEvqx41HGugz8J0X9Y6AkrRMipUBykYm4Y4wkUapQ0A=="}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:28:35.261530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:35.262734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:35.273264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:35.274452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:35.275693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:35.276556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:35.280485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:35.281316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:35.284183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-971626e0-5c2d-4961-a85c-4853aa1a84f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:28:35.296584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-971626e0-5c2d-4961-a85c-4853aa1a84f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for user ccd2c619e9fc436ea01a1200bc46b60f and project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:28:35.333537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-971626e0-5c2d-4961-a85c-4853aa1a84f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093406 Sep 01 08:28:35.334900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1723/3422] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:28:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:28:35.432547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:35.441308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d33b2b51-ef6c-4aef-ae2f-7baed6717d83 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.185462 Sep 01 08:28:35.464918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1700/3423] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:35 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:35.719933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:35.720586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:35.727491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:35.728277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:35.728904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:35.729798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:35.730577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:35.731216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:35.885349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:35.904596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2c50cb58-e7be-47da-a5f6-c3ed7b8d58fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.185869 Sep 01 08:28:35.908632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1724/3424] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:35 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:36.471871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:36.472617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:36.482616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:36.486840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:36.487405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:36.488754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:36.489480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:36.490080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:36.590556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:36.599142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fe8b7718-37da-446b-b4de-09c0e835cb9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.132058 Sep 01 08:28:36.600501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1701/3425] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:36 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:36.929995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:36.930636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:36.948071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:36.949376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:36.950239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:36.952320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:36.952995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:36.953854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:37.082282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:37.100524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-295ff5cf-b132-414d-bfa6-a160851b2926 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.173849 Sep 01 08:28:37.121180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1725/3426] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:36 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:37.389028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-212797388", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fa62a9c-7a6e-4c3a-b7c4-bcbe5e7ff18a"}], "security_groups": [{"name": "tempest-securitygroup--711333274"}], "key_name": "tempest-keypair-974400570", "user_data": "}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:28:37.506435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] validate_networks() for [('9fa62a9c-7a6e-4c3a-b7c4-bcbe5e7ff18a', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:28:37.620855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:37.621697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:37.625658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:37.632415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:37.633507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:37.634242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:37.635180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:37.636257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:37.636846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:37.766634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:37.784364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6668fc4c-15ae-401c-bdc2-cee036149429 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.165848 Sep 01 08:28:37.786235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1726/3427] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:37 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:38.135746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:38.137307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:38.157333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:38.157333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:38.157333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:38.157333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:38.158509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:38.158509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:38.255373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:38.262168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2cc02267-b776-42f0-9c80-c1bc60897309 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.134595 Sep 01 08:28:38.263305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1727/3428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:38 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:38.301385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:28:38.302349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:28:38.303142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:28:38.304263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:28:38.304907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:28:38.307687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:38.320515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:38.321091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:38.321530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:38.322287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:38.322757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:38.323172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:38.344021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:28:38.349832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for user ccd2c619e9fc436ea01a1200bc46b60f and project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:28:38.370931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:28:38.373428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:28:38.429269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0c5212a0-f6da-4fc8-bdc3-6012d8ba90c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.045013 Sep 01 08:28:38.430544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1702/3429] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:28:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 08:28:38.442621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca09d5a0-1d8a-4d02-84a6-eb5369e55230 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:38.443648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca09d5a0-1d8a-4d02-84a6-eb5369e55230 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:38.513555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca09d5a0-1d8a-4d02-84a6-eb5369e55230 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:38.521922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca09d5a0-1d8a-4d02-84a6-eb5369e55230 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1240 microversion: 2.1 time: 0.083914 Sep 01 08:28:38.522720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1728/3430] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:38 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:38.807486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:38.808239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:38.815920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:38.816738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:38.817711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:38.818758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:38.819307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:38.819944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:38.901016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:38.910741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a5ec1e3-ac49-49b3-bc3b-f8dd959b5c9c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.106704 Sep 01 08:28:38.911322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1703/3431] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:38 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:39.288119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:39.288595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:39.295455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:39.296145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:39.296585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:39.297496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:39.297950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:39.298765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:39.373822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:39.383536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c218a032-d9af-40af-91ad-8ca2b1664ac2 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.100646 Sep 01 08:28:39.386165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1729/3432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:39 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:39.541777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-75f4514d-e381-484c-9d5d-1d3d2d401945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:39.542418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-75f4514d-e381-484c-9d5d-1d3d2d401945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:39.646820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75f4514d-e381-484c-9d5d-1d3d2d401945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:39.659982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-75f4514d-e381-484c-9d5d-1d3d2d401945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1240 microversion: 2.1 time: 0.121481 Sep 01 08:28:39.661515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1704/3433] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:39 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:39.938481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:39.939700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:39.947596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:39.948601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:39.949381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:39.950566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:39.951275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:39.951880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:40.038351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:40.046173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f88b9887-28cc-422e-a12e-8114a44b7078 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.112210 Sep 01 08:28:40.046795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1730/3434] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:39 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:40.406475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:40.407210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:40.414233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:40.415626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:40.416068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:40.416851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:40.417296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:40.417766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:40.492262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:40.500467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a6987673-90b9-4b74-9481-99f37574b47a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.098055 Sep 01 08:28:40.501046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1705/3435] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:40 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:40.683026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0240ddc6-7303-42bc-b806-b7a3d2710db7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:40.683859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0240ddc6-7303-42bc-b806-b7a3d2710db7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:40.789054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0240ddc6-7303-42bc-b806-b7a3d2710db7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:40.798979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0240ddc6-7303-42bc-b806-b7a3d2710db7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1240 microversion: 2.1 time: 0.119938 Sep 01 08:28:40.799798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1731/3436] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:40 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:41.075029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:41.075920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:41.087198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:41.087931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:41.088526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:41.089877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:41.090834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:41.091504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:41.184158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:41.196854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9efa1a1-36b8-435c-af6b-bc6d95ed9e69 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.129335 Sep 01 08:28:41.198066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1706/3437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:41 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:41.522025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:41.522666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:41.528843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:41.529387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:41.529752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:41.530492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:41.530943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:41.531367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:41.618795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:41.628192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eccdec8f-de98-4889-b291-235553d3d8fa tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.110872 Sep 01 08:28:41.628720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1732/3438] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:41 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:41.822511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61b5ef3f-21a8-46b8-a482-78dc59b4c544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:41.823961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61b5ef3f-21a8-46b8-a482-78dc59b4c544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:41.896445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61b5ef3f-21a8-46b8-a482-78dc59b4c544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:41.905647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61b5ef3f-21a8-46b8-a482-78dc59b4c544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1240 microversion: 2.1 time: 0.088444 Sep 01 08:28:41.919335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1707/3439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:41 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:42.224938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:42.227097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:42.238350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:42.239646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:42.240297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:42.241087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:42.241654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:42.242099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:42.342217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:42.351244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d7fe281-8023-4e5a-848b-b636a6b58656 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.133598 Sep 01 08:28:42.352168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1733/3440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:42 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:42.648477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:42.649410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:42.660329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:42.660329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:42.660329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:42.660329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:42.660755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:42.660755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:42.736452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:42.746782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9b839782-b9de-4cf7-a0ec-9a58b20daa07 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.102273 Sep 01 08:28:42.747792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1708/3441] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:42 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:42.930627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:42.934364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:42.946880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:42.947812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:42.948652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:42.949925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:42.950772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:42.951560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:43.055861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:43.065448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b80eda3-5e16-429b-9047-c8d480839ef9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.140251 Sep 01 08:28:43.066361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1734/3442] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:42 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:43.388367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:43.390148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:43.400320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:43.401353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:43.402216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:43.403627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:43.404581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:43.405906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:43.520949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:43.529134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-662ad421-c811-44ba-9cbe-fb5472b352d4 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.147124 Sep 01 08:28:43.529700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1709/3443] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:43 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:43.769534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:43.771146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:43.777463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:43.778177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:43.779209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:43.780790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:43.781416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:43.782003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:43.870151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:43.880160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2656e359-082d-4a11-982d-325504702734 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.115746 Sep 01 08:28:43.880891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1735/3444] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:43 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:44.086987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:44.087771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:44.096862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:44.098310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:44.098464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:44.099743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:44.100377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:44.100816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:44.181606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:44.190215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4518db81-ebfa-4055-b29b-48f14ace2464 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.108323 Sep 01 08:28:44.190827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1710/3445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:44 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:44.552701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:44.553352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:44.560036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:44.560532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:44.561419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:44.562292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:44.562915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:44.563332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:44.639662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:44.651339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a3626b74-d9bd-43d5-b225-5c2baa4dcec9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.103602 Sep 01 08:28:44.652305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1736/3446] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:44 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:44.902527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:44.903128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:44.909304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:44.909792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:44.910200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:44.910905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:44.911352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:44.911762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:44.974359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:44.982365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-943ac080-1ff7-4f10-828c-33ee7cd61e51 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083899 Sep 01 08:28:44.982922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1711/3447] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:44 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:45.211703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:45.212353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:45.219304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:45.219304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:45.219304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:45.221634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:45.221634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:45.221634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:45.284851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:45.292673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44cb0902-cb8b-46e1-9e62-a2d6e8c5c85e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084751 Sep 01 08:28:45.293264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1737/3448] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:45 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:45.684757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:45.685644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:45.692147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:45.692638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:45.693070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:45.693766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:45.694218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:45.694670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:45.785178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:45.802821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b78985cd-c02b-4485-8b2d-f1119c9558ba tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.121472 Sep 01 08:28:45.804121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1712/3449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:45 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:46.006752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:46.007808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:46.016396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:46.017072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:46.018076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:46.018812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:46.019287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:46.019703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:46.109831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:46.122730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3751add0-d379-40ed-a611-26b378c82d73 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.122146 Sep 01 08:28:46.123938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1738/3450] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:45 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:46.325663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:46.326345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:46.333419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:46.333898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:46.334358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:46.335051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:46.335499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:46.335919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:46.398958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:46.407205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fcadf1a8-cc44-4421-bb79-4222d8272935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085429 Sep 01 08:28:46.407789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1713/3451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:46 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:46.839114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:46.839699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:46.845612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:46.846143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:46.846607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:46.847286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:46.847734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:46.848155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:46.908867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:46.916529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd24769c-9b1f-49d8-bb20-657f8f6433fe tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081264 Sep 01 08:28:46.917095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1739/3452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:46 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:47.147304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:47.148172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:47.154457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:47.154943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:47.155380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:47.156060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:47.156541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:47.156961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:47.222643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:47.225148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:47.234012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2a9a4a23-fa69-446a-8074-01f603ac3e99 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.092638 Sep 01 08:28:47.234857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1714/3453] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:47 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:47.430869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:47.431486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:47.440875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:47.441380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:47.442046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:47.442962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:47.443614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:47.444249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:47.509130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:47.517301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-45f962bd-0c6e-4943-bee1-00da366546ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.091284 Sep 01 08:28:47.517952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1740/3454] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:47 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:47.939080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:47.940264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:47.947384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:47.947867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:47.948301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:47.948990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:47.949437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:47.949857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:48.010964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:48.019047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f8b455d-6fb3-44f3-8a34-6464a2b3df6d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084697 Sep 01 08:28:48.019611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1715/3455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:47 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:48.270578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:48.271315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:48.277160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:48.277640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:48.278075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:48.278786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:48.279236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:48.279655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:48.343731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:48.352305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75069a3d-6dc6-4004-a48a-3bc19858d62a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086301 Sep 01 08:28:48.352883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1741/3456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:48 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:48.540001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:48.540625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:48.542562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:48.548482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:48.549613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:48.550093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:48.551214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:48.551791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:48.552312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:48.630414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:48.642935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0d815d45-13d7-4839-8578-a8ead80136ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.106719 Sep 01 08:28:48.644193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1716/3457] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:48 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:49.039427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:49.040021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:49.046151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:49.046663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:49.047128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:49.047822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:49.048269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:49.049225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:49.065341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:49.112090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:49.120126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3873dcf1-5a0a-4035-ab3c-59cec5be9f86 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084437 Sep 01 08:28:49.120715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1742/3458] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:49 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:49.373112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:49.373720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:49.380308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:49.380308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:49.381625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:49.382069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:49.382583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:49.383011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:49.447269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:49.456280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b9c115a-1d8a-4f7e-bf89-2d363634a4eb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086955 Sep 01 08:28:49.457119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1717/3459] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:49 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:49.668068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:49.668832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:49.677227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:49.678071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:49.678765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:49.679424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:49.679924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:49.680426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:49.754154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:49.763172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2836d7c2-c029-4365-879a-0c87e11ac8ff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.098903 Sep 01 08:28:49.763758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1743/3460] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:49 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:50.142191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:50.143544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:50.149565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:50.150050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:50.150512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:50.151200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:50.151653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:50.152077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:50.217345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:50.225435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09e4daa1-b148-46f3-b58c-35138caff6e7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087089 Sep 01 08:28:50.226039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1718/3461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:50 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:50.683544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:50.684148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:50.690617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:50.691064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:50.691491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:50.692174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:50.692644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:50.693060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:50.754469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:50.762046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7e39144-ba00-49fb-a040-84dd647cc681 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.288176 Sep 01 08:28:50.762674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1744/3462] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:50 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:50.785088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:50.785687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:50.791752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:50.792228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:50.792659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:50.793335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:50.793778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:50.794196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:50.857131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:50.866647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b317ed5f-7e91-420c-b004-5858f5072e36 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085878 Sep 01 08:28:50.867229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1719/3463] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:50 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:51.247268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:51.247882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:51.249759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=8 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:51.255728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:51.256205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:51.256638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:51.257334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:51.257784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:51.258203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:51.321839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:51.330391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4dcb9dd0-b217-4439-bcde-bc8fdf6a9fd6 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086338 Sep 01 08:28:51.331241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1745/3464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:51 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:51.782572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:51.783829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:51.789827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:51.790484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:51.790885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:51.791715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:51.792256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:51.792756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:51.864963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:51.873201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cefe5ecc-e103-4228-a45b-13a0216e091a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094523 Sep 01 08:28:51.873768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1720/3465] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:51 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:51.888833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:51.889731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:51.898251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:51.899004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:51.899436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:51.900323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:51.900776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:51.901194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:51.969900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:51.978313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce1c6e1a-8ec4-4249-b910-222be2afd28b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.093530 Sep 01 08:28:51.978890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1746/3466] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:51 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:52.352213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:52.352810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:52.354622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=10 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:52.359827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:52.360303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:52.360734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:52.362001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:52.362549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:52.362967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:52.422859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:52.431451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c7da4f7-d38a-4c84-adbb-7bc5239e478c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.083163 Sep 01 08:28:52.432022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1721/3467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:52 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:52.896580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:52.897299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:52.903723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:52.904213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:52.904647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:52.905348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:52.905829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:52.906287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:52.984579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:52.997479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ca94ef7e-4b4a-4727-8697-9ed9f8963552 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.104975 Sep 01 08:28:53.003728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1747/3468] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:52 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:53.004787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:53.006346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:53.019570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:53.020437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:53.021258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:53.022635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:53.023477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:53.024255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:53.102065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:53.118593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8882e16f-4809-401a-a045-da123c584769 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.121316 Sep 01 08:28:53.119675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1722/3469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:52 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:53.452132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:53.452729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:53.459738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:53.460217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:53.460642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:53.461323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:53.461766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:53.462177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:53.525124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:53.534233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d09ec4c0-59bd-4dbe-b371-27cebf45e942 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085887 Sep 01 08:28:53.535773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1748/3470] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:53 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:54.024250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:54.025103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:54.034325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:54.035261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:54.036174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:54.037470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:54.038355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:54.039151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:54.134753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:54.141238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f149f924-9240-4404-b77f-c3a9cbb90981 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.124919 Sep 01 08:28:54.142105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1723/3471] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:54 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:54.143259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:54.144456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:54.152734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:54.153789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:54.154589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:54.155648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:54.156387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:54.156950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:54.239591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:54.247962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6c2cce56-f685-48e5-a1cb-c6ec82030a49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.111284 Sep 01 08:28:54.248541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1749/3472] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:54 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:54.557571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:54.558646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:54.566743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:54.567436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:54.568476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:54.569581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:54.570166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:54.570817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:54.648410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:54.656307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-02a6999d-0197-44cc-859e-35d5d5b07c64 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.102672 Sep 01 08:28:54.656885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1724/3473] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:54 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:55.179791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:55.180618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:55.196857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:55.198783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:55.199921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:55.202028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:55.202753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:55.203888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:55.269412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:55.270137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:55.276399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:55.276884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:55.277316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:55.278014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:55.278557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:55.279023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:55.313181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:55.327909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-692016df-996c-435a-b1c0-43ee1ae5b159 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.156026 Sep 01 08:28:55.328712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1750/3474] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:55 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:55.387327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:55.397243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e4cc88ac-fa6c-4c7a-ab03-3f7fcd09413c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.132333 Sep 01 08:28:55.397890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1725/3475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:55 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:55.678389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:55.679040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:55.685079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:55.685563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:55.685998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:55.686723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:55.687173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:55.687592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:55.755687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:55.763443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b0978860-7118-446e-a45a-aa5145dde87d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090280 Sep 01 08:28:55.764107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1751/3476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:55 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:56.349476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:56.350078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:56.358736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:56.359075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:56.359507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:56.360190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:56.360668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:56.367314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:56.421201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:56.422196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:56.433894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:56.434593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:56.436473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:56.437380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:56.442670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:56.443268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:56.471559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:56.482344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4516602-66c3-4b0f-aed9-c0d2289ea412 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.135879 Sep 01 08:28:56.484007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1726/3477] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:56 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:56.545655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:56.567273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0178a0ba-e550-4514-a824-700a10095175 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.150317 Sep 01 08:28:56.586602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1752/3478] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:56 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:56.784772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:56.785428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:56.791462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:56.791945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:56.792788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:56.793283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:56.794176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:56.794176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:56.860660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:56.873936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fc984f65-76f7-426f-b7fc-34f1429299c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093550 Sep 01 08:28:56.874566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1727/3479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:56 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:57.510734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:57.512013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:57.518994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:57.519802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:57.520437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:57.521210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:57.521707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:57.522283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:57.593272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:57.594308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:57.605163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:57.605521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:57.606582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:57.607565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:57.609325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:57.610493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:57.612151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:57.624460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5e9a8f8-7a7b-4ebc-85d5-a95dd00a231f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.117336 Sep 01 08:28:57.629253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1753/3480] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:57 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:57.701976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:57.712761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1fe6463-bd9a-4ccd-9756-2770b8b3f0f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.125113 Sep 01 08:28:57.713343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1728/3481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:57 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:57.903381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:57.903995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:57.910886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:57.911407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:57.911845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:57.912541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:57.912995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:57.913421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:57.980723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:57.990288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52c779ff-b4dc-46af-8437-8b4d25cc2543 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093534 Sep 01 08:28:57.991115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1754/3482] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:57 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:58.663766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:58.665629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:58.672946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:58.674044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:58.674044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:58.674686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:58.675969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:58.677083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:58.733504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:58.744095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:58.750932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:58.754799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:58.755289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:58.756874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:58.757185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:58.757668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:58.758065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:58.761212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9a06c285-ee15-4ba6-8db7-998cdca45cc3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.103093 Sep 01 08:28:58.761797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1729/3483] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:58 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:58.838223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:58.847775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8520ab5a-bc8e-460b-87ce-1f6c8a6707a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.118149 Sep 01 08:28:58.848353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1755/3484] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:58 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:28:59.280035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:59.280747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:59.287595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:59.288146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:59.288649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:59.289402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:59.289948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:59.290480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:59.353257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:59.361380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e4f3507-424b-4dbb-9557-6a42fafac692 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.352567 Sep 01 08:28:59.362032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1730/3485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:59 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:59.783330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:59.784640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:59.791554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:59.792193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:59.792634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:59.793324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:59.794220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:59.794675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:59.872707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:28:59.873102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:28:59.877983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:59.880416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:59.880905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:59.881337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:59.882094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:28:59.882513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:28:59.883467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:28:59.891850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6744fc90-99e3-4087-bc96-668a61927709 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.112525 Sep 01 08:28:59.902716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1756/3486] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:59 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:28:59.902834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:59.970627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:28:59.979424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-db6f9592-3569-4a5f-b8b2-70cf678e7ea9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.112773 Sep 01 08:28:59.980007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1731/3487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:28:59 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:00.382028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:00.382855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:00.389261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:00.390004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:00.390719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:00.391656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:00.392384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:00.392873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:00.468212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:00.478063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e80e9a40-89ed-413a-825b-cd262ce27ea1 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100140 Sep 01 08:29:00.478821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1757/3488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:00 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:00.915371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:00.917118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:00.924934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:00.925680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:00.926114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:00.927117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:00.927986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:00.928477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:01.000477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:01.001301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:01.002886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:01.012104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:01.013248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:01.013891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:01.014697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:01.017598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:01.018980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:01.020369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9d93898-d03f-41a5-9e52-440b08f70e6f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.109977 Sep 01 08:29:01.022420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1732/3489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:00 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:01.120005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:01.137301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4be61308-b591-4be5-beec-e88eadf5561c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.140208 Sep 01 08:29:01.138797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1758/3490] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:00 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:01.499452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:01.500063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:01.506235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:01.506766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:01.507220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:01.507934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:01.511306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:01.511306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:01.580939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:01.588524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-880bb2d0-0ec4-4a66-8d81-d11845e738f7 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.092934 Sep 01 08:29:01.589093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1733/3491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:01 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:02.040879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:02.041853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:02.048363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:02.049052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:02.049532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:02.050187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:02.050687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:02.051175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:02.055560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:02.123560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:02.132067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9acbca40-b2ef-4eca-9269-2348a0c69413 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.094952 Sep 01 08:29:02.132837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1759/3492] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:02 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:02.163412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:02.164043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:02.171693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:02.172200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:02.172621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:02.173381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:02.173996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:02.174472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:02.244688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:02.254833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a6316752-15dc-45e5-8f0f-08bbd997ce3d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.097772 Sep 01 08:29:02.255074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1734/3493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:02 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:02.614957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:02.617504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:02.624950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:02.625439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:02.626060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:02.627765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:02.628495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:02.628929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:02.699045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:02.707248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8ee583e6-e7ef-46f0-ad91-8198181cb34d tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.101151 Sep 01 08:29:02.707888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1760/3494] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:02 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:03.152923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:03.153535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:03.160045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:03.160526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:03.160958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:03.161642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:03.162088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:03.162557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:03.234177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:03.249929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cce5d2c2-f6be-4546-99ec-d7fd01fbd340 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.098760 Sep 01 08:29:03.249929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1735/3495] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:03 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:03.277433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:03.278050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:03.284485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:03.284975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:03.285412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:03.286114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:03.286598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:03.287023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:03.353629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:03.366307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9eeef1e2-8c3b-420a-a1e8-cbd2d3b43c2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092294 Sep 01 08:29:03.367262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1761/3496] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:03 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:03.729828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:03.730478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:03.738273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:03.739371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:03.740121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:03.740821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:03.741271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:03.741841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:03.821631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:03.830976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4f264864-ea8d-4272-9d43-ba25785e2009 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.106890 Sep 01 08:29:03.832398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1736/3497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:03 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:04.271493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:04.272142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:04.278353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:04.278971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:04.279259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:04.279975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:04.280422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:04.280840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:04.358248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:04.367819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a890511d-b187-41ad-831f-14eb8c11b941 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.100322 Sep 01 08:29:04.368468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1762/3498] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:04 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:04.399758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:04.400503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:04.407333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:04.408629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:04.409065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:04.409926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:04.410406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:04.410824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:04.475809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:04.483596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a459b326-c150-42ae-8655-cba4293ed7e0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087917 Sep 01 08:29:04.484392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1737/3499] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:04 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:04.852911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:04.853547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:04.859733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:04.860215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:04.860764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:04.861482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:04.861933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:04.862389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:04.929584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:04.938151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33f4b68f-2282-412d-8432-6bd4e83dcae9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.089364 Sep 01 08:29:04.938723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1763/3500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:04 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:05.393908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:05.395003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:05.404572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:05.405615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:05.406156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:05.407551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:05.408584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:05.409008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:05.493766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:05.504677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:05.505383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:05.505767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ddaa1d39-240e-4b07-84d2-45d3cde5ea2d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.118126 Sep 01 08:29:05.506613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1738/3501] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:05 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:05.512055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:05.512618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:05.513115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:05.513872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:05.514420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:05.514904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:05.583610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:05.593276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-acaf3e4e-7089-4e3b-b035-0cb3985d770d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092390 Sep 01 08:29:05.594691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1764/3502] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:05 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:05.960049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:05.960660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:05.966530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:05.967013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:05.967449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:05.968134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:05.968585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:05.969005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:06.033840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:06.042651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70ab969c-b6a1-456c-90aa-f28f45d592f8 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087105 Sep 01 08:29:06.043342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1739/3503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:05 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:06.533290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:06.533749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:06.543361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:06.544228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:06.544823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:06.545929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:06.546419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:06.547097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:06.616458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:06.617191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:06.631985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:06.634677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:06.635168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:06.635911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:06.636376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:06.636799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:06.645095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:06.655025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9183eca-7792-4d36-8315-3086cb8e7281 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.127563 Sep 01 08:29:06.655863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1765/3504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:06 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:06.743801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:06.751681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9222c592-f188-4ed5-a88a-ec7500c133a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.139024 Sep 01 08:29:06.752259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1740/3505] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:06 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:07.063764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:07.065306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:07.071743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:07.074868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:07.074868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:07.074868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:07.074868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:07.075444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:07.145302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:07.153133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b9f79598-f8e5-4bcc-8279-2211f6f6b447 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.093199 Sep 01 08:29:07.153704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1766/3506] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:07 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:07.682126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:07.683155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:07.691638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:07.692258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:07.692934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:07.693947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:07.699881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:07.699881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:07.773643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:07.780718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:07.781996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:07.782172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-83f0e5c3-176d-4419-8576-5d9833ac8d62 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.105687 Sep 01 08:29:07.783838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1741/3507] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:07 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:07.802841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=86 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:07.812292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:07.812847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:07.813286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:07.814638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:07.815433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:07.815864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:07.888266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:07.898747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-614af10f-4ffe-4f65-9d12-fe5297a9d47b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.126916 Sep 01 08:29:07.899344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1767/3508] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:07 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:08.174979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:08.175588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:08.181418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:08.181884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:08.182330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:08.183010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:08.183565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:08.184021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:08.253080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:08.261455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5f5db64f-dc89-42d9-8bea-ecbc404f0c54 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090364 Sep 01 08:29:08.274326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1742/3509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:08 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:08.818984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:08.819685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:08.825723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:08.826215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:08.826667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:08.827365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:08.827814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:08.828230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:08.895255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:08.905132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fbd987da-2509-4e34-82bc-0da6fe8c4d86 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091732 Sep 01 08:29:08.905713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1768/3510] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:08 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:08.925305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:08.926003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:08.928355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:08.934912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:08.935675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:08.936107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:08.937063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:08.937518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:08.937945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:09.009396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:09.019355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0aa62dca-5699-49e8-b8fc-c9ca98677698 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.097866 Sep 01 08:29:09.019950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1743/3511] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:08 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:09.286971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:09.288748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:09.296037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:09.296601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:09.297103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:09.297860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:09.299218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:09.299562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:09.362390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:09.370746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21a921fa-bb82-4d01-ba84-896de718ddab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.090167 Sep 01 08:29:09.371400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1769/3512] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:09 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:09.928524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:09.930149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:09.943162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:09.944134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:09.945078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:09.946011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:09.946654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:09.947236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:10.016320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:10.026051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5981d15e-04e7-41d9-a20f-286804e9e3a1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.101620 Sep 01 08:29:10.026906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1744/3513] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:09 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:10.044385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:10.045006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:10.051699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:10.052182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:10.052644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:10.053330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:10.053767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:10.054178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:10.117197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:10.125051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ef66824a-8da5-4723-a9c4-fc0bdca0d91c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085431 Sep 01 08:29:10.125611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1770/3514] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:10 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:10.392143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:10.392644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:10.398771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:10.399248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:10.399741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:10.400360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:10.400799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:10.401215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:10.474632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:10.482581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4273baa9-daf2-405c-8469-9da5bc322650 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.094386 Sep 01 08:29:10.483213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1745/3515] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:10 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:11.046419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:11.047028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:11.053646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:11.054059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:11.054547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:11.055150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:11.055604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:11.056023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:11.139954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:11.149437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:11.150250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:11.156239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e28cb3cc-772e-4555-a283-b48cba5ee804 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.113188 Sep 01 08:29:11.162100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1771/3516] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:11 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:11.162379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:11.162379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:11.162379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:11.163442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:11.164397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:11.165207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:11.261138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:11.271949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e93b49e9-1f78-4f49-a715-21dcd28ca606 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.127265 Sep 01 08:29:11.272923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1746/3517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:11 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:11.504871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:11.505476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:11.511611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:11.512024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:11.512450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:11.513150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:11.513710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:11.514218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:11.591492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:11.600071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed31fefd-3002-4694-a574-84ba4a372c93 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.099763 Sep 01 08:29:11.600853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1772/3518] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:11 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:12.189134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:12.189774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:12.195750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:12.196253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:12.196678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:12.197359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:12.197802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:12.198221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:12.270160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:12.278637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-869adce7-5f3a-4bc9-bf4c-c6d5740de534 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.093171 Sep 01 08:29:12.279210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1747/3519] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:12 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:12.292899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:12.293517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:12.301356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:12.301935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:12.302488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:12.303229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:12.303689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:12.304431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:12.390543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:12.399260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7dedba74-eb14-4c89-978d-cf5c9b909ca6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.110071 Sep 01 08:29:12.399761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1773/3520] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:12 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:12.621163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:12.622021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:12.628616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:12.629440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:12.629878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:12.630649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:12.631098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:12.631749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:12.635045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:12.708013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:12.716838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f781e34b-e80a-4ff7-a45d-e05d0b780272 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.099520 Sep 01 08:29:12.717415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1748/3521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:12 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:13.300198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:13.300835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:13.306732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:13.307221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:13.307653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:13.308567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:13.309025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:13.309455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:13.374465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:13.387587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-baf5a621-b34c-4eea-ad24-93f856901876 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091797 Sep 01 08:29:13.388327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1774/3522] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:13 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:13.420189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:13.421547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:13.428566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:13.429055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:13.429490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:13.430187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:13.430667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:13.431118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:13.496076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:13.504029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9dfc4390-cf78-481f-8395-a9744d79e174 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087735 Sep 01 08:29:13.504600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1749/3523] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:13 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:13.740652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:13.741255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:13.747098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:13.747581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:13.748008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:13.748681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:13.749126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:13.749545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:13.813730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:13.816812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:13.824924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4bd690b5-7c5a-4789-ac2c-49a8229c8b76 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088076 Sep 01 08:29:13.825504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1775/3524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:13 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:14.411099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:14.411582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:14.418039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:14.418598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:14.419027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:14.419928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:14.420377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:14.420932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:14.493743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:14.505325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b956075-8645-4862-8ac6-03642f5ada19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.099803 Sep 01 08:29:14.510501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1750/3525] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:14 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:14.526786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:14.527395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:14.534189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:14.534699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:14.535127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:14.535864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:14.536288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:14.536709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:14.604104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:14.613730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e8964e4-94f0-4ada-ac26-5d29492525b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092398 Sep 01 08:29:14.614332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1776/3526] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:14 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:14.845750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:14.846660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:14.853640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:14.854201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:14.854777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:14.855504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:14.856079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:14.856580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:14.932800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:14.942060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ea4cf04-23e1-4f2b-8fc8-f016cd5f7fa0 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.100468 Sep 01 08:29:14.942923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1751/3527] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:14 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:15.527261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:15.528065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:15.535336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:15.535874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:15.536294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:15.537022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:15.537541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:15.538002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:15.610074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:15.619295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d3a18c34-7028-47da-a622-4cdd80214fda tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.095860 Sep 01 08:29:15.620133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1777/3528] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:15 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:15.643932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:15.645157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:15.659276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:15.660166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:15.660947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:15.662191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:15.663126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:15.663968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:15.740348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:15.748082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f733d786-d739-41aa-a355-a7330b7e2676 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.115472 Sep 01 08:29:15.748649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1752/3529] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:15 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:15.971414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:15.972305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:15.979043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:15.979525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:15.979962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:15.980663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:15.981176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:15.981602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:16.213073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:16.223801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f8e46926-bfb2-4c2c-8b8a-94847cfa01dd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.257272 Sep 01 08:29:16.224631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1778/3530] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:15 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:16.641159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:16.642788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:16.651122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:16.652143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:16.652143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:16.652740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:16.653220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:16.653907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:16.730772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:16.739959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-00c923b4-0786-4558-b690-409afe3a03b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.102684 Sep 01 08:29:16.745679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1753/3531] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:16 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:16.778006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:16.779227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:16.790765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:16.791650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:16.792441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:16.793740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:16.794628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:16.795418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:16.869791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:16.883741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47b7c76e-7955-41ce-bdc9-a625f084d0b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.112581 Sep 01 08:29:16.884366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1779/3532] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:16 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:17.246132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:17.246725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:17.253510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:17.253997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:17.254461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:17.255164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:17.255614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:17.256039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:17.323102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:17.332032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9a8f4b38-39b0-4c86-90ef-8a59f70dd32e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.089622 Sep 01 08:29:17.332623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1754/3533] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:17 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:17.775217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:17.775725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:17.782297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:17.783158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:17.783400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:17.784108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:17.784557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:17.784981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:17.858395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:17.866689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2632defc-de2e-42ab-894e-22488d8857fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.095857 Sep 01 08:29:17.867279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1780/3534] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:17 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:17.905067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:17.905676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:17.912222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:17.912711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:17.913147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:17.913849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:17.914322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:17.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:17.982695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:17.990741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-73990702-710d-4123-b4e2-85001217c9b5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.089520 Sep 01 08:29:17.991321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1755/3535] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:17 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:18.354897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:18.355513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:18.363825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:18.364529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:18.365070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:18.366220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:18.366828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:18.367353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:18.433266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:18.445056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1d75c646-803e-4deb-a9f0-4b625f7223bd tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095611 Sep 01 08:29:18.446699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1781/3536] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:18 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:18.894718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:18.896704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:18.912762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:18.913830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:18.914592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:18.915972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:18.916660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:18.917360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:19.019999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:19.024602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:19.036111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:19.037195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:19.037872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:19.038999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:19.039737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:19.040390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:19.053302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:19.065886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2dc80a36-21bb-4c50-842d-625046c223ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.181681 Sep 01 08:29:19.067182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1756/3537] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:18 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:19.147749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:19.162247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2a46dbdf-72c3-48bc-87f5-a4dc7324d790 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.147097 Sep 01 08:29:19.164514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1782/3538] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:19 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:19.470724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:19.470724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:19.476259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:19.476760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:19.477230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:19.477945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:19.478510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:19.478939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:19.547862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:19.559941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-851af74b-4e2b-422b-9654-514965ec5afb tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.095686 Sep 01 08:29:19.560632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1757/3539] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:19 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:20.107676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:20.108858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:20.120436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:20.120928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:20.121363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:20.122091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:20.122600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:20.123021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:20.197739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:20.199094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:20.208986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:20.209552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:20.209873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:20.211040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:20.211594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:20.212090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:20.234426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:20.247560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85b0e29d-1391-4ad2-abb5-53b373bfe8ee tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.147556 Sep 01 08:29:20.248454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1783/3540] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:20 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:20.327604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:20.336389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e9ade89-98e7-4eaa-8072-204a31140511 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.146419 Sep 01 08:29:20.337265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1758/3541] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:20 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:20.598016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:20.600201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:20.617270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:20.618434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:20.619297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:20.620533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:20.621114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:20.621639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:20.727855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:20.743975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a3da66e5-4d62-4c50-8ef2-31a759309015 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.153832 Sep 01 08:29:20.759093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1784/3542] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:20 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:21.279210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:21.280073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:21.291710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:21.291710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:21.291710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:21.292953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:21.293444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:21.293865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:21.367424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:21.369729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:21.370545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:21.380055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:21.380610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:21.381156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:21.381867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:21.382407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:21.383072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:21.383992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-332a36b8-9f0c-4360-923c-54be716c7d5c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.108716 Sep 01 08:29:21.386041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1759/3543] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:21 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:21.514156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:21.539150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aec101a0-c207-46b7-9afd-9ffcf8ac8000 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.174830 Sep 01 08:29:21.539750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1785/3544] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:21 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:21.782858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:21.784087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:21.795983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:21.797491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:21.799451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:21.799773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:21.800432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:21.802407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:21.912368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:21.921612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fea0c6ba-d931-49f6-87a8-5d4cbcb54c1c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.145076 Sep 01 08:29:21.922663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1760/3545] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:21 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:22.409181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:22.411960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:22.434645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:22.443091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:22.444673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:22.447765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:22.453117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:22.453563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:22.579033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:22.592201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:22.592997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf2e068b-c3e1-4109-888e-f4c6949bdde0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.188220 Sep 01 08:29:22.600315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1786/3546] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:22 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:22.604004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:22.623769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:22.624700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:22.628301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:22.630293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:22.631388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:22.632376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:22.755524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:22.767894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-628eaf95-9e72-4887-a116-f0b59def129c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.196404 Sep 01 08:29:22.769411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1761/3547] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:22 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:22.946489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:22.947183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:22.955571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:22.956796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:22.957617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:22.958490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:22.959146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:22.959824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:23.050018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:23.069733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0152955-4f27-4b98-8613-3533ae30ca90 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.127016 Sep 01 08:29:23.071109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1787/3548] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:22 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:23.628550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:23.630416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:23.640667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:23.642606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:23.643274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:23.644580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:23.645325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:23.646024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:23.766759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:23.780672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b1b18b9-a8fe-40a9-83df-1ef76392da8c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.159801 Sep 01 08:29:23.794066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:23.794973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1762/3549] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:23 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:23.796281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:23.805617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:23.806777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:23.807830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:23.809025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:23.809908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:23.810649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:23.917878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:23.947634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b78718ee-4667-4cd6-a6c8-5d2d1acd4a9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.160368 Sep 01 08:29:23.948783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1788/3550] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:23 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:24.100732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:24.101354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:24.107706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:24.108479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:24.109110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:24.110185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:24.111397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:24.112039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:24.243748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:24.257884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8b478db-044a-488e-85ae-e286684f1f9e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.160847 Sep 01 08:29:24.266476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1763/3551] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:24 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:24.805740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:24.807701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:24.816359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:24.817056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:24.817856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:24.818617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:24.819079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:24.819686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:24.933233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:24.946755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-34394c3f-4080-4933-8842-3c497d7f9c2b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.145184 Sep 01 08:29:24.948235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1789/3552] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:24 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:24.973725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:24.974677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:24.984578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:24.986805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:24.988479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:24.990063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:24.991254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:24.992395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:25.130546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:25.136591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:25.150173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b5c7a19-f312-4ac5-b3bb-7479628175d1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.181637 Sep 01 08:29:25.151927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1764/3553] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:24 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:25.293291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:25.302764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:25.320369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:25.321535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:25.333078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:25.334698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:25.335594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:25.336422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:25.489677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:25.499059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8bc25de1-4884-40cb-a482-f942b93d6b3b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.212733 Sep 01 08:29:25.500625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1790/3554] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:25 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:25.988398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:25.989841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:26.001929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:26.003029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:26.003921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:26.005181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:26.006029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:26.007137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:26.191151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:26.192288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:26.212948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:26.214052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:26.214931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:26.216595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:26.217620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:26.218651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:26.404928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:26.417678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c15f63f0-e97c-4ba5-b91c-d54b8a3006e9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.439899 Sep 01 08:29:26.421389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1765/3555] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:25 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:26.446170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:26.457804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7bbfaca5-d87b-46dd-9326-50708dac954c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.275350 Sep 01 08:29:26.458787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1791/3556] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:26 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:26.539481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:26.540460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:26.550367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:26.550870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:26.551307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:26.552037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:26.552495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:26.552921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:26.664051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:26.689299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c621a3dc-6bfc-431a-a777-29cd0ea5acb5 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.155800 Sep 01 08:29:26.703162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1766/3557] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:26 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:27.450313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:27.451101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:27.460221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:27.460891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:27.461543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:27.462251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:27.462742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:27.463178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:27.482297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:27.489053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:27.490375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:27.497042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:27.497924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:27.498562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:27.499447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:27.500084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:27.500503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:27.556543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:27.566522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-afbe9acf-37b0-4483-973f-94e05e502623 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.121383 Sep 01 08:29:27.567544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1792/3558] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:27 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:27.592200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:27.605293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a24073d-5549-4da0-91dd-04770cd58fb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.119830 Sep 01 08:29:27.610314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1767/3559] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:27 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:27.714049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:27.714966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:27.721920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:27.722920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:27.723348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:27.724053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:27.724527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:27.724948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:27.825858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:27.838323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d68bad5-4509-43fc-ad09-d43142e40a1f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.128409 Sep 01 08:29:27.838967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1793/3560] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:27 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:28.608064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:28.609345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:28.628656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:28.629432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:28.630189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:28.631226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:28.632347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:28.632966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:28.635702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:28.637705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:28.658368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:28.661764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:28.662434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:28.664559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:28.665748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:28.666858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:28.759276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:28.777741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ac794424-9dfa-4a5e-b4b2-996667884395 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.173340 Sep 01 08:29:28.779063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1768/3561] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:28 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:28.816052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:28.825062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dfcbbfcd-c7c5-4fc7-a79e-ce841f158850 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.200092 Sep 01 08:29:28.836813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1794/3562] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:28 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:28.860069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:28.861635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:28.868813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:28.869309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:28.869751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:28.870522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:28.870983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:28.871408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:29.031365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:29.042002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf5ad854-3afd-46de-b52e-ecbfd4a06445 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.186026 Sep 01 08:29:29.043970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1769/3563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:28 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:29.816818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:29.816818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:29.828382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:29.829194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:29.830473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:29.831211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:29.832318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:29.833089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:29.858117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:29.865798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:29.880557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:29.880557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:29.881073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:29.881873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:29.882616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:29.883067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:29.953429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:29.973241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-981cbaf1-be31-4012-8d83-a3df329acc2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.162983 Sep 01 08:29:29.974333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1795/3564] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:29 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:30.002772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:30.015848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f24174a4-2ae5-43a3-acff-2a2a360d4991 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.171839 Sep 01 08:29:30.017942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1770/3565] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:29 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:30.070594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:30.071478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:30.083898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:30.084748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:30.085632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:30.086986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:30.088225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:30.088891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:30.224586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:30.233920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44e7bcfe-715a-47ff-9345-2692831f9954 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.169031 Sep 01 08:29:30.235440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1796/3566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:30 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:30.996949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:30.997617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:31.016519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:31.017849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:31.019837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:31.028112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:31.031012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:31.037132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:31.057219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:31.066915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:31.088553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:31.090466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:31.100320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:31.103020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:31.109651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:31.111466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:31.279993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:31.282986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:31.294431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-042773fc-6ded-4842-82d7-477d04b65ef6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.246991 Sep 01 08:29:31.295853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1797/3567] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:31 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:31.306112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:31.307066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3fa0d12b-9b75-420f-a180-cc80251e05da tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.313317 Sep 01 08:29:31.307482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:31.308142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1771/3568] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:30 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:31.315898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:31.316955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:31.317641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:31.318712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:31.326685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:31.327210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:31.474451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:31.498434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc79f641-50bd-456c-87b5-37f1686a3d3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.200823 Sep 01 08:29:31.499927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1798/3569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:31 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:32.334067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:32.335142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:32.342445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:32.343614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:32.348932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:32.351732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:32.354581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:32.356432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:32.357176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:32.357828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:32.378914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:32.379530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:32.380308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:32.381589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:32.382531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:32.383291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:32.441681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:32.457598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e6c1825-2d84-4503-adfd-0da3bbf4ed14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.129059 Sep 01 08:29:32.458646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1772/3570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:32 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:32.522440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:32.523301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:32.535721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:32.539961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:32.540578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:32.541499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:32.543680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:32.544377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:32.575247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:32.585267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9753ef2f-b123-4237-9b59-0a3f081d80ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.256013 Sep 01 08:29:32.590361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1799/3571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:32 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:32.659412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:32.669286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a761d11b-458d-42d7-a2c4-a0f64cdfd83e tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.150801 Sep 01 08:29:32.672692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1773/3572] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:32 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:33.480529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:33.481834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:33.489400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:33.489876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:33.490607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:33.491319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:33.491778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:33.492339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:33.576983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:33.590734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc10c6ba-c890-4708-84bd-7b43502bef0c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.114958 Sep 01 08:29:33.591675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1800/3573] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:33 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:33.620139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:33.622142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:33.632314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:33.633183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:33.633899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:33.635463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:33.636433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:33.637630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:33.712900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:33.713555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:33.722128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:33.723285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:33.723920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:33.724922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:33.725394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:33.725820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:33.740121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:33.749175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b1deb4a-7553-40f8-9cd6-cbd40b849276 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.138449 Sep 01 08:29:33.752374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1774/3574] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:33 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:33.803543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:33.816057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fb339e8c-e132-4cfb-97ab-945d80e888a2 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.107432 Sep 01 08:29:33.822670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1801/3575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:33 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:34.626562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:34.628789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:34.655004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:34.655874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:34.656306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:34.657012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:34.663062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:34.663564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:34.753828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:34.764483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a8537ea-0b21-4933-8b0d-ff0e4bf7115d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.144637 Sep 01 08:29:34.777124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1775/3576] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:34 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:34.785285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:34.785898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:34.788238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:29:34.788635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d (ip 10.222.0.43) !!! Sep 01 08:29:34.809725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:34.810209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:34.810952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:34.811719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:34.812172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:34.812595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:34.844989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:34.846292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:34.857961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:34.859772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:34.861401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:34.862899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:34.863770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:34.864523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:34.923898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:34.944258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7419a60e-28f2-476a-9388-22f358341904 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.163322 Sep 01 08:29:34.944870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1802/3577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:34 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:35.015440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:35.026124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-516dc5f9-7af3-4298-8f86-7297b49a241c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.188381 Sep 01 08:29:35.027157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1776/3578] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:34 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:35.790991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:35.792425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:35.800924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:35.801899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:35.802603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:35.803596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:35.804347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:35.805561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:35.878226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:35.887636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7c793075-b0f0-4e0d-8e80-1c4ae5fa1f3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.101454 Sep 01 08:29:35.888841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1803/3579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:35 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:35.966499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:35.967392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:35.984369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:35.984857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:35.985613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:35.986365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:35.986818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:35.987518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:36.057307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:36.057931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:36.069748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:36.070251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:36.070745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:36.071468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:36.071918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:36.072344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:36.078351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:36.092544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6671fb0e-dd69-42ef-9e74-7e263e351d02 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.129883 Sep 01 08:29:36.109159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1777/3580] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:35 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:36.148939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:36.158615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f93916f6-052e-4188-bbd0-3d4b1eea33df tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.105096 Sep 01 08:29:36.159969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1804/3581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:36 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:36.914523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:36.916241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:36.927794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:36.929145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:36.930243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:36.931893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:36.933057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:36.934162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:37.055637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:37.074427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3285ef1a-c3c6-40bb-889d-db283fc0c3b6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.167798 Sep 01 08:29:37.081936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1778/3582] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:36 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:37.116692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:37.118482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:37.133024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:37.135263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:37.135962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:37.137468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:37.147876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:37.148891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:37.210316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:37.212850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:37.227085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:37.227955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:37.228862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:37.231635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:37.233685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:37.234890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:37.249970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:37.263672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2cc88d39-5d83-4021-bf34-311b5485a0c9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.150671 Sep 01 08:29:37.264694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1805/3583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:37 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:37.327949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:37.343526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-10e66696-501f-4b1b-9d96-e3df7edf9586 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.156085 Sep 01 08:29:37.345164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1779/3584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:37 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:38.106570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:38.106570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:38.113228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=78 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:38.115803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:38.116725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:38.118246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:38.119304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:38.120020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:38.122488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:38.217927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:38.233322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3bb78bf7-78c2-49b9-aa5d-c53ff0da004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.135385 Sep 01 08:29:38.234085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1806/3585] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:38 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:38.288021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:38.288885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:38.300613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:38.302831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:38.303745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:38.305116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:38.309278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:38.309963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:38.371442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:38.373073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:38.401534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:38.402193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:38.402744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:38.404418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:38.404418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:38.404872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:38.414903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:38.431675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5369acac-469b-418c-ae8d-335a2b3f58c6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.146002 Sep 01 08:29:38.434418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1780/3586] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:38 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:38.505562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:38.519154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9eaf6619-8318-4b3b-8a4d-45972d696922 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.155582 Sep 01 08:29:38.519634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1807/3587] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:38 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:39.257260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:39.258457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:39.261035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=76 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:39.274073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:39.277045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:39.279774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:39.291368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:39.292074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:39.292285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:39.327368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:39.392976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:39.410106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80ada613-7d3c-48a4-a444-5a617bb407c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.156781 Sep 01 08:29:39.411142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1781/3588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:39 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:39.463377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:39.465036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:39.477682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:39.478245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:39.478814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:39.479634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:39.480155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:39.480648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:39.566923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:39.568409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:39.580244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:39.580805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:39.581790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:39.583176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:39.583831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:39.584553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:39.625564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:39.653622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18b0948c-89ff-4d1c-b143-eec333b8ba65 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.193616 Sep 01 08:29:39.656343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1808/3589] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:39 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:39.701021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:39.711821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ea83a2f-cf78-4167-b01c-ecb091eaec7f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.169488 Sep 01 08:29:39.712818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1782/3590] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:39 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:40.432814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:40.433428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:40.454843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:40.455329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:40.455758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:40.456725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:40.457173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:40.458874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:40.488563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:40.557641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:40.570876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c8a9e87f-1dcb-4818-9dab-f1f69ef35c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.142287 Sep 01 08:29:40.572304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1809/3591] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:40 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:40.679968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:40.681429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:40.695804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:40.697668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:40.699010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:40.701266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:40.703220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:40.705823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:40.735721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:40.736992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:40.744989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:40.745973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:40.746859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:40.747804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:40.748480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:40.749136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:40.818481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:40.830379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-50caa384-5bf8-42bc-8493-f1b7772c8bae tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.153390 Sep 01 08:29:40.831292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1783/3592] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:40 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:40.867312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:40.879958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44a969ac-fa25-4b74-b0c3-b03bd497bcf3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.150745 Sep 01 08:29:40.881653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1810/3593] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:40 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:41.593676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:41.594444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:41.600734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:41.601215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:41.601643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:41.602366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:41.602798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:41.603242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:41.671463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:41.680787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24824c90-f681-4758-a054-bbc2b9cdf941 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.091541 Sep 01 08:29:41.682695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1784/3594] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:41 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:41.852174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:41.852814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:41.859230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:41.859720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:41.860204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:41.861445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:41.861984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:41.862440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:41.901245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:41.902642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:41.912033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:41.912738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:41.913237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:41.914225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:41.915340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:41.916412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:41.928703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:41.938179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f56bfec5-f69b-4165-bdb1-ffc5208c220c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089926 Sep 01 08:29:41.940336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1811/3595] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:41 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:41.998890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:42.006817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cad9c55b-68f4-4f31-9481-6f726345c864 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.109360 Sep 01 08:29:42.007419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1785/3596] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:41 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:42.702401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:42.703128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:42.712505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:42.712995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:42.713427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:42.714276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:42.714732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:42.715156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:42.790719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:42.800579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a4bff565-d91c-4c70-a2be-2581ceeb159c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.102347 Sep 01 08:29:42.801153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1812/3597] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:42 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:42.963336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:42.964754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:42.971631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:42.972128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:42.972561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:42.973256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:42.973735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:42.974216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:43.028748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:43.030129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:43.046437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:43.047481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:43.048466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:43.049276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:43.049733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:43.053184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:43.056821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:43.063336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e7e4b397-4a88-430b-913a-b9252cb592d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.103840 Sep 01 08:29:43.065074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1786/3598] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:42 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:43.125113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:43.134279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c05f7e5d-de82-4f3e-9a57-cc32c9cd7e13 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.109185 Sep 01 08:29:43.135132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1813/3599] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:43 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:43.821219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:43.821831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:43.827907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:43.828551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:43.830165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:43.830165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:43.830165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:43.830632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:43.902721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:43.912447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a48320d-c520-4334-b644-4c27dc6d5605 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.095253 Sep 01 08:29:43.913456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1787/3600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:43 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:44.087898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:44.088573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:44.095642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:44.096421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:44.097068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:44.097818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:44.098381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:44.098806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:44.156647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:44.157756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:44.166183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:44.171714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:44.176069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:44.176924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:44.181423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b98ee501-eb81-4798-8cec-f547a99f6d3a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.099768 Sep 01 08:29:44.182037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1814/3601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:44 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:44.182874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:44.183345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:44.183771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:44.249251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:44.257667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a742b3b-cd56-4455-86ae-98a050918eca tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.105373 Sep 01 08:29:44.258565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1788/3602] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:44 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:44.935509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:44.936449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:44.943630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:44.944252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:44.944821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:44.945630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:44.946345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:44.946838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:45.012752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:45.022166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fa8b090c-fe74-4555-b748-a9335d70ce4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090420 Sep 01 08:29:45.023182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1815/3603] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:44 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:45.203402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:45.204565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:45.210917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:45.211381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:45.211860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:45.212588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:45.212922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:45.213357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:45.228147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-396ed60e-96e9-440e-99dc-bc41ec89b021 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Action: 'create', calling method: .version_select at 0x7f2ac0045af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-111356440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7VqS0P3SbZALt7Ga2DSBz7YfcKfS41QXJGJYALxDjR/YyVLH9fZNrhKaicf5C48G3jvyjzOloJEB1MIJ+GVmvyGbc/PHC+BOR07i52kC4ZPlXdiykbfJIktGRMgxS27g=="}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:29:45.243294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-396ed60e-96e9-440e-99dc-bc41ec89b021 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Getting quotas for project 5d7a479aae1144f289a9c79417c064b4. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:29:45.247104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-396ed60e-96e9-440e-99dc-bc41ec89b021 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Getting quotas for user 6f56c04652d4406a8af97bd4b0268bc6 and project 5d7a479aae1144f289a9c79417c064b4. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:29:45.270709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-396ed60e-96e9-440e-99dc-bc41ec89b021 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046269 Sep 01 08:29:45.271430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1816/3604] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:29:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 08:29:45.278354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:45.287700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aed11d27-1abb-4f7d-a889-b99599e52f23 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088084 Sep 01 08:29:45.288489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1789/3605] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:45 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:45.288624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:45.289279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:45.297499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:45.297998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:45.298475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:45.299689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:45.299832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:45.300231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:45.374484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:45.380566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2108689279", "imageRef": "c613139c-9229-4793-9be0-65be8857fb60", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-111356440", "networks": [{"uuid": "0d4560e6-3e49-42c8-b2a5-d46c3ed5d3aa"}]}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:29:45.383165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-27bfcb3f-ee85-43b7-9594-6f095d74edab tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.101665 Sep 01 08:29:45.383731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1817/3606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:45 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:45.432664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] validate_networks() for [('0d4560e6-3e49-42c8-b2a5-d46c3ed5d3aa', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:29:45.835556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:29:45.835975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:29:45.836441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:29:45.836845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:29:45.837249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:29:45.845925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:45.846440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:45.846870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:45.847578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:45.848022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:45.848438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:45.864955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Getting quotas for project 5d7a479aae1144f289a9c79417c064b4. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:29:45.868761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Getting quotas for user 6f56c04652d4406a8af97bd4b0268bc6 and project 5d7a479aae1144f289a9c79417c064b4. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:29:45.879951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:29:45.881987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c613139c-9229-4793-9be0-65be8857fb60',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:29:45.926512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2645086-e7ae-48eb-8b1c-dfb0ba509323 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550195 Sep 01 08:29:45.927157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1790/3607] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:29:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 08:29:45.937656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5c1f6cdd-f57c-4b32-80e3-bb1399644d8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:45.938353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5c1f6cdd-f57c-4b32-80e3-bb1399644d8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:45.991068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5c1f6cdd-f57c-4b32-80e3-bb1399644d8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:45.997966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5c1f6cdd-f57c-4b32-80e3-bb1399644d8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1258 microversion: 2.1 time: 0.064051 Sep 01 08:29:45.998561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1818/3608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:45 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:46.044110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:46.044715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:46.051672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:46.052156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:46.052582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:46.053269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:46.053806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:46.054120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:46.117739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:46.126629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-59a70f4d-7c11-44fe-a7e3-8c9973d4d949 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086317 Sep 01 08:29:46.127205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1791/3609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:46 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:46.309471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:46.310187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:46.317176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:46.317752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:46.318482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:46.319182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:46.319640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:46.320063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:46.384728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:46.392526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3925f256-8009-4671-8e78-8e496f29b7e3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087338 Sep 01 08:29:46.393099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1819/3610] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:46 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:46.403205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:46.403963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:46.411015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:46.411501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:46.411936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:46.412627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:46.413075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:46.413494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:46.478853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:46.487148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8ff12fb7-fc44-4f77-be61-d01d08be9ac9 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.087728 Sep 01 08:29:46.487719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1792/3611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:46 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:47.019516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:47.020131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:47.026016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.026525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.026959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.027635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.028083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.028505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.089438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:47.097642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8b1d1c45-ee71-42b3-8343-21dd635332d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082018 Sep 01 08:29:47.098206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1820/3612] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:47 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:47.147338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:47.147937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:47.153935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.154434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.154861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.155540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.155978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.156392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.217284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:47.226172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19c050c3-8bc2-461a-bf40-b795e53ba5da tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082582 Sep 01 08:29:47.226768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1793/3613] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:47 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:47.413540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:47.414176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:47.420141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.420619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.421051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.421725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.422171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.422644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.482912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:47.490675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d26787d6-1c90-43f3-a1e5-fb838d3add11 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080899 Sep 01 08:29:47.491236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1821/3614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:47 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:47.507294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:47.507899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:47.513696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.514168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.514631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.515329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:47.515770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:47.516183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:47.579632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:47.587574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5ffdf431-441f-4561-a44a-d4bb98988e08 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084020 Sep 01 08:29:47.588138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1794/3615] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:47 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:48.117940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:48.118498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:48.124336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.124810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.125250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.126582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.127031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.127447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.186481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:48.194637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0da7be2-27a0-483d-97d7-aba62b1d14b8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080519 Sep 01 08:29:48.195202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1822/3616] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:48 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:48.247474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:48.248075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:48.254841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.255323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.255752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.256430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.256880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.257297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.317481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:48.325046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e2164b07-7170-4a9a-9c5b-2c1eb4246d5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081435 Sep 01 08:29:48.325597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1795/3617] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:48 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:48.510995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:48.511609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:48.517640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.518111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.518566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.519240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.519681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.520094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.580627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:48.588483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a49598a2-6a9b-47cc-bae1-650ad465c946 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081238 Sep 01 08:29:48.589039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1823/3618] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:48 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:48.613400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:48.614032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:48.620034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.620513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.620945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.621636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:48.622089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:48.622547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:48.689316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:48.697493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-270e4b27-1a55-4910-a629-e541130f990a tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.088836 Sep 01 08:29:48.698077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1796/3619] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:48 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:49.215878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:49.216480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:49.223023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.223494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.223920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.224599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.225039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.225451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.284104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:49.291656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d9e0582d-094b-441e-8faa-9cc8c49d6e2d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079638 Sep 01 08:29:49.292211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1824/3620] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:49 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:49.346520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:49.347168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:49.353168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.353643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.354080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.354825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.355277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.355696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.414953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:49.422612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-16d3bb59-2b2c-4f4c-83ee-bee237945e08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080552 Sep 01 08:29:49.423808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1797/3621] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:49 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:49.609385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:49.609926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:49.617917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.618430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.618867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.619553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.620001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.620427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.680430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:49.688074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61444b0a-e97f-4ecf-8a7c-bc0f2be5ce10 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082593 Sep 01 08:29:49.689063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1825/3622] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:49 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:49.718508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:49.719120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:49.725977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.726497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.726928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.727616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:49.728063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:49.728482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:49.790962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:49.793088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:49.799773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f2e5bdb-64da-490b-9d75-e094495fe193 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.085304 Sep 01 08:29:49.800335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1798/3623] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:49 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:50.313087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:50.313931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:50.320181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.320649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.321075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.321749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.322188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.322690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.383588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:50.391099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a588f96-cba7-4962-8266-f2dd2c06e3be tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081860 Sep 01 08:29:50.392169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1826/3624] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:50 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:50.443663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:50.444396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:50.450390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.450862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.451287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.451957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.452397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.452809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.513020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:50.520984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b4885f32-8ee6-4ba5-aed7-c55ede688634 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081117 Sep 01 08:29:50.521538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1799/3625] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:50 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:50.709249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:50.709847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:50.716278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.716749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.717173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.717847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.718315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.718736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.778595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:50.780708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:50.787722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4699d8b-d433-46b4-a968-4ac8dd72fb8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082673 Sep 01 08:29:50.788299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1827/3626] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:50 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:50.820395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:50.821006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:50.826955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.827466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.827923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.828600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:50.829690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:50.830202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:50.892620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:50.900764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d5a5f03b-426f-48bb-8be8-d37f241d7b7c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084222 Sep 01 08:29:50.901332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1800/3627] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:50 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:51.413166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:51.413764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:51.420077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.420552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.420976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.421651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.422092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.422536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.487736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:51.495394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-abbe9398-b345-458c-b585-7c5a33369a55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086065 Sep 01 08:29:51.495945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1828/3628] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:51 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:51.541780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:51.542409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:51.549036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.549503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.549925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.550624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.551062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.551474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.612919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:51.620410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5bc1e414-9aa7-4716-9aa8-2aa1518b6503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082380 Sep 01 08:29:51.620961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1801/3629] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:51 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:51.808646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:51.809299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:51.815699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.816176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.816627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.817397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.817842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.818273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.878492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:51.885917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2e3b8ad-ae6f-4496-8b1f-bf39316de3fb tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081290 Sep 01 08:29:51.886515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1829/3630] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:51 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:51.920835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:51.921430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:51.927678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.928160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.928603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.929287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:51.929732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:51.930143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:51.992213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:51.999611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a17aa511-9ef5-4277-82c8-b741d6654e97 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082638 Sep 01 08:29:52.000166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1802/3631] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:51 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:52.516306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:52.517485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:52.523340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:52.523812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:52.524247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:52.524915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:52.525360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:52.525776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:52.645422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:52.646028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:52.652776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:52.653255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:52.653685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:52.654416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:52.654867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:52.655291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:52.736519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:52.744413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-343064cf-1004-4de2-a1cb-2018a67e75a5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.231879 Sep 01 08:29:52.744988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1830/3632] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:52 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:52.762244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:52.770119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47d405b5-9c0d-44ed-938e-4d9624e9e72d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.128972 Sep 01 08:29:52.770745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1803/3633] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:52 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:52.907488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:52.908324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:52.914061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:52.914565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:52.915002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:52.915671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:52.916118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:52.916530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:52.976736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:52.984367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-303e4bf4-752d-496c-911a-5b045bde0980 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081175 Sep 01 08:29:52.984868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1831/3634] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:52 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:53.020182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:53.021170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:53.027632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:53.028105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:53.028529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:53.029202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:53.029642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:53.030053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:53.089659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:53.098589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47757554-1528-4b4a-b02e-beb9a65051c3 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082072 Sep 01 08:29:53.099157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1804/3635] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:53 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:53.765292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:53.765841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:53.772729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:53.773199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:53.773624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:53.774320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:53.774767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:53.775182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:53.790530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:53.791304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:53.797097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:53.797607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:53.798145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:53.799006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:53.799458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:53.799883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:53.839520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:53.847277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9598f0ad-5413-4674-9e57-cb0f0ac18918 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085884 Sep 01 08:29:53.847842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1832/3636] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:53 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:53.864286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:53.872360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aa0e0289-3bb4-44ff-9ce7-0319356a8437 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085629 Sep 01 08:29:53.872911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1805/3637] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:53 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:54.005864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:54.006484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:54.012329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.012805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.013235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.013914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.014401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.014821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.074957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:54.084581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38d3916e-f9da-46d9-873d-fe5f9af44965 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082566 Sep 01 08:29:54.085234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1833/3638] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:54 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:54.119470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:54.120073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:54.127181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.127648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.128073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.128739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.129180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.129591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.190285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:54.197751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4de2166e-7cab-43f7-b280-279b9f9b9e19 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.082088 Sep 01 08:29:54.198321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1806/3639] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:54 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:54.867917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:54.868522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:54.874517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.875001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.875435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.876316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.876762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.877183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.893641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:54.894244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:54.900591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.901063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.901487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.902162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:54.902641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:54.903055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:54.942537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:54.950300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b3e7687-5991-4fbb-883a-3d83be60c0a7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086178 Sep 01 08:29:54.951446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1834/3640] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:54 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:54.968332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:54.976878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9e8a070d-ffb3-4ba6-aa89-6d76d9729a60 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087663 Sep 01 08:29:54.977441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1807/3641] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:54 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:55.104899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:55.105650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:55.111843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:55.112322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:55.112753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:55.113436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:55.113883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:55.114324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:55.174399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:55.181977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-affef3b9-97e1-4606-94ba-31b8effcc6d8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080892 Sep 01 08:29:55.182591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1835/3642] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:55 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:55.218931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:55.219571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:55.225471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:55.225943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:55.226407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:55.227081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:55.227520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:55.227932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:55.287183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:55.294896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28173a65-8dbb-4282-a1df-41e55748fb3c tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.079764 Sep 01 08:29:55.295451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1808/3643] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:55 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:55.973561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:55.974251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:55.980209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:55.980686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:55.981145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:55.981819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:55.982280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:55.982731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:55.996781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:55.997376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:55.998197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=6 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:55.999278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:56.000091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=6 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:56.007156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:56.007635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:56.008062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:56.008743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:56.009182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:56.009622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:56.046043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:56.054532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5a61ee1e-60c3-4efe-920e-e1cce8f43c50 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085493 Sep 01 08:29:56.055162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1836/3644] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:55 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:56.075480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:56.084293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-479d9803-483b-4f5f-93fd-5c1276ca3ed3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.091318 Sep 01 08:29:56.084862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1809/3645] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:55 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:56.201888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:56.202538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:56.208662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:56.209141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:56.209572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:56.210247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:56.210719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:56.211138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:56.271180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:56.278752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8bf7ba9d-e423-48ee-9439-279f4d30523d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080750 Sep 01 08:29:56.279319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1837/3646] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:56 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:56.315005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:56.315615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:56.322041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:56.322482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:56.322910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:56.323591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:56.324031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:56.324448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:56.389055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:56.397127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f55efb5a-0746-48af-871a-944087f93369 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.086219 Sep 01 08:29:56.397681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1810/3647] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:56 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:57.075774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:57.076381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:57.082730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.083213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.083701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.084379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.084828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.085249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.105478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:57.106078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:57.112635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.113105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.113528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.114685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.114685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.115075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.145066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:57.152763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-edb6d1d0-b15f-42b7-97f6-ef94141ce071 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080800 Sep 01 08:29:57.153364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1838/3648] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:57 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:57.177881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:57.185466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3e61f5d9-0876-404e-8da9-a50791239537 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083812 Sep 01 08:29:57.186017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1811/3649] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:57 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:57.300015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:57.300644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:57.306544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.307014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.307437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.308108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.308550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.308963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.368288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:57.376577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe51e640-b8f0-4d32-83cf-de47631d808f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080384 Sep 01 08:29:57.377144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1839/3650] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:57 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:57.417921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:57.418578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:57.425053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.425559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.425987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.426676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:57.427118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:57.427530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:57.488502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:57.496036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f2a05da3-de2a-49c1-ace7-698935b263af tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.081831 Sep 01 08:29:57.496587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1812/3651] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:57 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:58.174323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:58.174935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:58.180854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.181329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.181757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.182469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.182919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.183340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.205386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:58.205989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:58.212201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.212678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.213105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.213793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.214236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.214680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.243561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:58.251364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3bb2ebbc-ed3e-4576-b7d5-e15af211934f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081955 Sep 01 08:29:58.251935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1840/3652] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:58 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:58.277198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:58.285941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-77784134-3dc1-4c15-bedd-0f8370c2e749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084540 Sep 01 08:29:58.286545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1813/3653] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:58 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:58.397082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:58.397714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:58.403592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.404062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.404492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.405163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.405604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.406016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.466147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:58.474344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d3729d06-368c-478b-afb1-34196681b97a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081025 Sep 01 08:29:58.474907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1841/3654] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:58 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:58.515975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:58.516784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:58.522985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.523471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.523903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.524585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:58.525058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:58.525479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:58.588759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:58.597019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4e48c936-2438-4bd8-8b9a-1c5cb172d05f tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084803 Sep 01 08:29:58.597579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1814/3655] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:58 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:59.271933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:59.272530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:59.278367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.278845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.279271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.279938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.280380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.280793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.306995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:59.307603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:59.313555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.314034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.314501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.315195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.315642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.316062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.331839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:59.342528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:59.350936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a1f0081e-4f82-4a61-87ce-f77f08eb9279 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082782 Sep 01 08:29:59.351508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1842/3656] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:59 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:59.379911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:59.387438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d8b1c72-573a-48b7-8be9-cb95300d0fa4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084200 Sep 01 08:29:59.387988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1815/3657] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:59 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:29:59.495220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:59.495828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:59.501887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.502395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.502832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.503506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.503948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.504361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.563183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:59.570678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e093bbe4-3af1-4743-9d9d-53150ef5ca6a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.079179 Sep 01 08:29:59.571471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1843/3658] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:59 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:29:59.616828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:29:59.617414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:29:59.623368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.623838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.624262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.624929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:29:59.625403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:29:59.625914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:29:59.687742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:29:59.697623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f46c3caa-0d1d-4ca9-8b9d-7541ab5353ed tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084451 Sep 01 08:29:59.698412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1816/3659] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:29:59 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:00.371568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:00.372169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:00.378807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.379280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.379704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.380408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.380816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.381230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.395726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:00.408139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:00.408742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:00.414751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.415225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.415654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.416332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.416775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.417190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.443046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:00.451032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-74a88eba-c248-45b1-acd6-dec87df0ace4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083272 Sep 01 08:30:00.454302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1844/3660] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:00 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:00.485710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:00.493667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4c6fc4fd-8087-40ba-acca-97f90f99f032 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.089870 Sep 01 08:30:00.494232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1817/3661] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:00 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:00.592520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:00.593111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:00.599716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.600194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.600624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.601302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.601749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.602174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.664564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:00.681421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-559eb270-ce52-4bd0-a9d2-987d8b65e7de tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.092712 Sep 01 08:30:00.681995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1845/3662] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:00 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:00.720480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:00.721086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:00.726995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.727475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.727907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.728615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.729063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.729480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.791468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52600a45490f46cf944278b2d0684080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed36f6fed0453c9f341c358c347dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:00.799906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28b02ec0-3d8c-44d1-8108-97d73e314b14 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 200 len: 1218 microversion: 2.1 time: 0.084011 Sep 01 08:30:00.800469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1818/3663] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:00 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:00.819111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:00.819627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:00.825428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.825901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.826355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.827034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.827479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.827896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.852989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:30:00.862231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:00.862717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:00.863145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:00.875334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lazy-loading 'flavor' on Instance uuid a75c6396-9f0a-4808-971e-c739707b7eff {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:30:00.886912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lazy-loading 'system_metadata' on Instance uuid a75c6396-9f0a-4808-971e-c739707b7eff {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:30:00.902926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lazy-loading 'metadata' on Instance uuid a75c6396-9f0a-4808-971e-c739707b7eff {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:30:01.033008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Deleted allocations for instance a75c6396-9f0a-4808-971e-c739707b7eff Sep 01 08:30:01.046996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:01.058077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d080de4b-a310-4c32-8b6e-750d85c28286 tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 204 len: 0 microversion: 2.1 time: 0.242566 Sep 01 08:30:01.058754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1846/3664] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:30:00 2022] DELETE /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:30:01.067846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:01.068445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] [instance: a75c6396-9f0a-4808-971e-c739707b7eff] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:01.074378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.074854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.075281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.075952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.076391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.076801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.090593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] HTTP exception thrown: Instance a75c6396-9f0a-4808-971e-c739707b7eff could not be found. Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Request method failure captured: Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff HTTP/1.1 Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGweNLSBCP_XBKDTyIAK2d6HjE2_5U2M0LgnRSPHthoA0d9nodbWIBdV0pE6GnwSR7BWWMkYUdmb8Y5lg9HkaJ23Amjc5tdloE5FnYIPqQIjRkbNxi2AsUaO5E824RPyNPfx2Dt7mYId2YCAo3GgYvdirsaj7WSQ3kzCd8UxFb7CRDM Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: 34ed36f6fed0453c9f341c358c347dcb Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-VolumesNegativeTest-418090978 Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:30:01.092096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34ed36f6fed0453c9f341c358c347dcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34ed36f6fed0453c9f341c358c347dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34ed36f6fed0453c9f341c358c347dcb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34ed36f6fed0453c9f341c358c347dcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-VolumesNegativeTest-418090978 Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: 34ed36f6fed0453c9f341c358c347dcb Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-VolumesNegativeTest-418090978 Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-VolumesNegativeTest-418090978-project Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: 52600a45490f46cf944278b2d0684080 Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-VolumesNegativeTest-418090978-project Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance a75c6396-9f0a-4808-971e-c739707b7eff could not be found. Sep 01 08:30:01.093944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': 'a75c6396-9f0a-4808-971e-c739707b7eff'} Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75c6396-9f0a-4808-971e-c739707b7eff could not be found. Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:30:01.095077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75c6396-9f0a-4808-971e-c739707b7eff could not be found. Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75c6396-9f0a-4808-971e-c739707b7eff could not be found. Sep 01 08:30:01.096776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:30:01.098232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] Returning 404 to user: Instance a75c6396-9f0a-4808-971e-c739707b7eff could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:30:01.098232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9bcb0f5d-9187-4e00-9b8a-b3b51a559e7b tempest-VolumesNegativeTest-418090978 tempest-VolumesNegativeTest-418090978-project] 10.222.0.43 "GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff" status: 404 len: 111 microversion: 2.1 time: 0.030127 Sep 01 08:30:01.098232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1819/3665] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:01 2022] GET /compute/v2.1/servers/a75c6396-9f0a-4808-971e-c739707b7eff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:30:01.473410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:01.474030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:01.480253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.480737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.481169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.481911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.482395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.482821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.513969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:01.514842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:01.521464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.522230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.522376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.523215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.523642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.524052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.546594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:01.555392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9db09afc-1d95-42e8-8914-11214985f7cd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.087422 Sep 01 08:30:01.555969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1847/3666] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:01 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:01.596694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:01.604562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4dac526f-b581-415b-b604-f912d4da889b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.094288 Sep 01 08:30:01.605121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1820/3667] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:01 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:01.702738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:01.703343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:01.710726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.711212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.711666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.712338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:01.712792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:01.713212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:01.779468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:01.787704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fc2ad4d9-48a2-4219-ae2d-2b2919d7a823 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089060 Sep 01 08:30:01.788183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1848/3668] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:01 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:02.577208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:02.577818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:02.587004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:02.587542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:02.587975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:02.588827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:02.589285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:02.589714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:02.624835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:02.625428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:02.641249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:02.641754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:02.642189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:02.642923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:02.643407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:02.643990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:02.664321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:02.673445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e8c952b-1eed-4212-a811-4303720d6f39 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.099418 Sep 01 08:30:02.674444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1821/3669] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:02 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:02.708512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:02.716071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20f9d8e2-1f11-42b3-9598-d1e59494b6c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.094896 Sep 01 08:30:02.716498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1849/3670] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:02 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:02.808815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:02.809323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:02.815977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:02.815977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:02.816343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:02.817150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:02.817463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:02.817883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:02.882845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:02.890635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-11f9d3de-f0c8-41ce-bad1-fe48e72d8c21 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085703 Sep 01 08:30:02.891374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1822/3671] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:02 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:03.696295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:03.696863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:03.704306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:03.704799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:03.705223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:03.706144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:03.707009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:03.707373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:03.739049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:03.740288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:03.742211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:03.748320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:03.751989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:03.752562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:03.753396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:03.753866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:03.754353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:03.793575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:03.807789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-67eb3b0e-aac4-459d-9dea-171fb9d5afea tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.116023 Sep 01 08:30:03.808473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1850/3672] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:03 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:03.826568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:03.836254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2a2205ac-b86d-469d-b39d-c32e3b29af2c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.102497 Sep 01 08:30:03.836918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1823/3673] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:03 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:03.912470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:03.913284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:03.921127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:03.921236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:03.921782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:03.923098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:03.923624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:03.924116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:03.986495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:03.994024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b2b9ef0-60f6-4e7b-b5b2-64be6e3c7285 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085425 Sep 01 08:30:03.994616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1851/3674] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:03 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:04.830090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:04.830730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:04.836945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:04.837415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:04.837841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:04.838542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:04.838982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:04.839400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:04.858922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:04.859522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:04.865705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:04.866179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:04.866641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:04.867323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:04.867773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:04.868191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:04.901648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:04.909979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b04e64ca-466b-4fcd-afc8-e6fd7a4f34d5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084194 Sep 01 08:30:04.910594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1824/3675] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:04 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:04.930326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:04.937857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6f04b120-1d76-452b-a023-ca68dd6c3859 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082778 Sep 01 08:30:04.938931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1852/3676] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:04 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:05.015139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:05.015740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:05.022325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:05.022804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:05.023233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:05.023979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:05.024427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:05.024853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:05.086708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:05.096475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3aeed84-039a-4eff-80d0-0db9ea168ef3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085084 Sep 01 08:30:05.097050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1825/3677] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:05 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:05.934879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:05.935502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:05.943730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:05.944204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:05.944644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:05.945317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:05.945764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:05.946183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:05.959243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:05.959856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:05.965829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:05.966335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:05.966767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:05.967444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:05.967882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:05.968296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:06.017030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:06.024329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3b4e38fd-eb71-4d8e-a8af-0bd7e12f3a00 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.093364 Sep 01 08:30:06.024902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1853/3678] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:05 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:06.035932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:06.043508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-985a51d3-76a3-48d8-af39-21ef7fa437c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088348 Sep 01 08:30:06.044061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1826/3679] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:05 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:06.116964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:06.117564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:06.123642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:06.124121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:06.124554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:06.125233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:06.126505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:06.126935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:06.189676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:06.197123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e23a3faa-0d82-4fa8-914f-6a3cb11f2118 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083978 Sep 01 08:30:06.197685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1854/3680] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:06 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:07.044984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:07.045673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:07.052293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:07.052765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:07.053193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:07.053868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:07.054339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:07.054757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:07.065194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:07.065801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:07.072037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:07.072513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:07.072945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:07.073633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:07.074077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:07.074526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:07.129286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:07.137354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47863617-3a35-43af-978b-6833a11e9c96 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.096211 Sep 01 08:30:07.137933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1827/3681] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:07 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:07.150030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:07.158962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-84e31320-2016-47f6-9fc2-a686d71cba23 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.098256 Sep 01 08:30:07.159565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1855/3682] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:07 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:07.218294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:07.218919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:07.225420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:07.225895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:07.226354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:07.227026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:07.227472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:07.227890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:07.289037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:07.296574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cb24b166-4434-4e29-9c60-d19514a1563e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082037 Sep 01 08:30:07.297212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1828/3683] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:07 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:08.158522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:08.159194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:08.165063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:08.165801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:08.166224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:08.166914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:08.167358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:08.167776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:08.179981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:08.180589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:08.186636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:08.187118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:08.187553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:08.188825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:08.189296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:08.189749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:08.232828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:08.237311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:08.243025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0db83bff-b10e-4fc1-b029-d0bea2d770c3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088665 Sep 01 08:30:08.243704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1856/3684] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:08 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:08.261158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:08.269070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1921028b-58f3-4e7b-b971-733c791e236b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092931 Sep 01 08:30:08.269619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1829/3685] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:08 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:08.317674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:08.318301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:08.324962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:08.325444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:08.325884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:08.326589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:08.327040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:08.327466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:08.387905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:08.395837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-97f9e62d-8aa0-497f-b45f-0d9c78bed6b1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082910 Sep 01 08:30:08.396389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1857/3686] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:08 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:09.263742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:09.264334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:09.271047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:09.271518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:09.271948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:09.272837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:09.273286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:09.273704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:09.288858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:09.289497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:09.295597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:09.296096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:09.296523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:09.297205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:09.297708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:09.298126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:09.335221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:09.343261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2b893c3-2629-4e5b-a28b-f967130ff634 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083283 Sep 01 08:30:09.343832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1830/3687] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:09 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:09.361199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:09.368647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-54768ad4-1c27-4617-af74-0af28eeaa2b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083599 Sep 01 08:30:09.369192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1858/3688] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:09 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:09.416729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:09.417264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:09.423105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:09.423573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:09.423999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:09.424665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:09.425104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:09.425518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:09.490954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:09.498452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8772a428-86cd-4718-8a73-755d99fb2128 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085504 Sep 01 08:30:09.499000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1831/3689] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:09 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:10.365687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:10.366317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:10.372228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:10.372701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:10.373132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:10.373813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:10.374280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:10.374709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:10.388857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:10.389477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:10.395854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:10.396333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:10.396759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:10.397480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:10.397923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:10.398363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:10.441858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:10.446211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3059e5d4-ee72-4fd1-bb5f-10be61665e65 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084346 Sep 01 08:30:10.446833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1859/3690] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:10 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:10.465162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:10.467407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:10.475090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-835778a4-453b-4381-b2fc-458560bb528d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090008 Sep 01 08:30:10.475666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1832/3691] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:10 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:10.519224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:10.519856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:10.525745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:10.526217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:10.526677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:10.527352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:10.527796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:10.528214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:10.593945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:10.602233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c06433c6-ca03-40ee-b624-6c40676ebd95 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086996 Sep 01 08:30:10.602883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1860/3692] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:10 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:11.468405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:11.469345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:11.476489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:11.477087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:11.477624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:11.478541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:11.479085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:11.479610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:11.495436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:11.496135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:11.502862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:11.503339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:11.503765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:11.504444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:11.504882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:11.505294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:11.542579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:11.551087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3505b074-2e2a-490a-a278-d5d6d99c2ae2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086795 Sep 01 08:30:11.551666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1833/3693] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:11 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:11.591469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:11.599799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17acae74-e89a-4781-96f5-d40e69ec9096 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.108129 Sep 01 08:30:11.600370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1861/3694] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:11 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:11.622776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:11.623383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:11.630063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:11.630581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:11.631015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:11.631704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:11.632153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:11.632577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:11.694741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:11.702351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ef0428e4-ca43-49fd-96b3-5e3047619a8b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083400 Sep 01 08:30:11.702911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1834/3695] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:11 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:12.572611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:12.573216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:12.579526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:12.580002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:12.580433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:12.581367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:12.581816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:12.582230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:12.620861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:12.621456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:12.627469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:12.627942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:12.628371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:12.629054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:12.629497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:12.629915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:12.643072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:12.650960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-457a64fe-1ab0-4051-be2e-8a0eafdb9ebc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082552 Sep 01 08:30:12.651807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1862/3696] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:12 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:12.690726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:12.698328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec5c7a10-d1e3-4fac-bcaa-b72df40a5e1c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081148 Sep 01 08:30:12.698887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1835/3697] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:12 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:12.723408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:12.723945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:12.729825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:12.730331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:12.730764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:12.731447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:12.731891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:12.732312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:12.793685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:12.801914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7a0eff2-1b10-416b-8262-f59d2ae4134d tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082978 Sep 01 08:30:12.802510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1863/3698] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:12 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:13.672239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:13.672879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:13.678789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:13.679264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:13.679699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:13.680371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:13.680818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:13.681234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:13.721279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:13.721968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:13.728810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:13.729212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:13.729636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:13.730342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:13.730774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:13.731189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:13.742340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:13.753121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0cabf091-421d-4123-a389-5f8238c2e562 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084591 Sep 01 08:30:13.753721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1836/3699] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:13 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:13.799037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:13.806764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac797864-e559-4f8e-a37a-56a5764426d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090957 Sep 01 08:30:13.807332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1864/3700] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:13 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:13.823302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:13.823937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:13.829969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:13.830496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:13.830919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:13.831848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:13.832288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:13.832699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:13.891874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:13.899726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-63ec24a5-3c42-4754-8bba-6ff9d6fd3a22 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080097 Sep 01 08:30:13.900360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1837/3701] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:13 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:14.775646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:14.776197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:14.782191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:14.782721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:14.783154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:14.783835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:14.784282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:14.784700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:14.828173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:14.829367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:14.835629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:14.836108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:14.836537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:14.837212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:14.837651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:14.838062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:14.847445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:14.855030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d5e8a0f4-7e5d-452e-af49-78a9704c5980 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083301 Sep 01 08:30:14.855592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1865/3702] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:14 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:14.898461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:14.906033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-60118868-b562-4d79-9c3a-6ac352e8dabc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081764 Sep 01 08:30:14.906664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1838/3703] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:14 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:14.920608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:14.921209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:14.927145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:14.927597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:14.928019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:14.928689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:14.929129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:14.929545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:14.990066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:14.997525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41cabb94-4ac4-46b3-92e5-9dfb202b83d9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080730 Sep 01 08:30:14.998072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1866/3704] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:14 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:15.876564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:15.877136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:15.883036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:15.883505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:15.883930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:15.884600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:15.885041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:15.885454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:15.926701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:15.927300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:15.933183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:15.933652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:15.934075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:15.934779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:15.935309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:15.935635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:15.945491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:15.953070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6dac4ea1-e8d1-4466-9250-8bed905da9fe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081110 Sep 01 08:30:15.953944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1839/3705] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:15 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:15.998764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:16.007418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-42a5473a-4e27-46a7-8a17-8cefd323ac76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085236 Sep 01 08:30:16.007978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1867/3706] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:15 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:16.018466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:16.019153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:16.025315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:16.025874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:16.026339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:16.027020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:16.027466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:16.027885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:16.089271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:16.096909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d80a73f2-f9ca-48e2-8040-c7b32a74a2b0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082358 Sep 01 08:30:16.097462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1840/3707] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:16 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:16.974310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:16.974936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:16.980777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:16.981244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:16.981667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:16.982381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:16.982809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:16.983227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:17.028026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:17.028643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:17.035291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:17.035773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:17.036243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:17.037168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:17.037725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:17.038249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:17.043981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:17.052541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a158dd4e-a0da-462a-a6ac-5b0562fb2e85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082067 Sep 01 08:30:17.053236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1868/3708] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:16 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:17.100861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:17.108828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8f323b87-bb3b-4861-bac5-60c147aac478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084551 Sep 01 08:30:17.109411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1841/3709] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:17 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:17.117641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:17.118278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:17.124234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:17.124710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:17.125144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:17.126186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:17.126695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:17.127117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:17.189134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:17.196675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-68b782d4-333d-4347-88f8-d50c39e43c43 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083045 Sep 01 08:30:17.197225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1869/3710] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:17 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:18.074624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:18.075255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:18.081564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:18.082034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:18.082485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:18.083154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:18.083595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:18.084009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:18.130779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:18.131415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:18.136842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:18.137321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:18.137753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:18.138480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:18.138931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:18.139408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:18.144418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:18.151869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dddd1ffc-3276-4c9f-ba75-b97b22263ac1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081050 Sep 01 08:30:18.152428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1842/3711] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:18 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:18.200393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:18.208399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d5cd43ef-672a-4b2e-866c-23bd842ba725 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082688 Sep 01 08:30:18.208975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1870/3712] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:18 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:18.216735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:18.217339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:18.223313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:18.223783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:18.224213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:18.224883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:18.225322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:18.225736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:18.285090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:18.292489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-73249e5c-d0fa-4b4b-b6ff-d908ff98ab18 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.079575 Sep 01 08:30:18.293041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1843/3713] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:18 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:19.172612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:19.173208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:19.179067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:19.179540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:19.179966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:19.180632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:19.181072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:19.181485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:19.228840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:19.229436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:19.235512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:19.235997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:19.236430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:19.237117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:19.237562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:19.237981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:19.245806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:19.253875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-af27a6de-f2cd-4dbe-a25d-08217ba69350 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085044 Sep 01 08:30:19.254814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1871/3714] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:19 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:19.299758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:19.307255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1da55143-16b8-4dc0-ba7a-c73b2638e229 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082165 Sep 01 08:30:19.307823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1844/3715] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:19 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:19.313385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:19.314007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:19.319974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:19.320449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:19.320876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:19.321544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:19.321984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:19.322435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:19.404719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:19.414675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5aa051d0-688b-4887-bd0e-1e860a7c7744 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.105390 Sep 01 08:30:19.415255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1872/3716] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:19 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:20.274935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:20.275558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:20.282251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:20.282970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:20.283410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:20.284097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:20.284546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:20.284966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:20.328094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:20.329399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:20.335627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:20.336100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:20.336525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:20.337204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:20.337643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:20.338054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:20.346372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:20.354216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b4116653-7df4-4694-b404-0590233e3ec2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083026 Sep 01 08:30:20.354823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1845/3717] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:20 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:20.357298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:20.402691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:20.410557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-77a8dd5f-ea8a-4039-a178-4a5f15ad4b5c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086082 Sep 01 08:30:20.411112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1873/3718] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:20 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:20.435906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:20.436508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:20.443416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:20.443892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:20.444324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:20.445007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:20.445450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:20.445864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:20.507112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:20.514668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b198c4d5-ef05-46bd-88c6-d96c08c95dcf tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082519 Sep 01 08:30:20.515218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1846/3719] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:20 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:21.376440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:21.377090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:21.383003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:21.383476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:21.383900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:21.384577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:21.385018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:21.385435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:21.430249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:21.431767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:21.437091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:21.437610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:21.438099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:21.439239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:21.439695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:21.440118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:21.445653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:21.453209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02c1e4e3-659f-4da4-8b04-d4e11e26a342 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081257 Sep 01 08:30:21.453756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1874/3720] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:21 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:21.502881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:21.510008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b0f54985-04be-4254-a2ad-adecb4bf1e05 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083567 Sep 01 08:30:21.510589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1847/3721] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:21 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:21.535458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:21.536069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:21.543199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:21.543740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:21.544177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:21.544867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:21.545320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:21.545745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:21.612027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:21.619658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-69cea63b-3f7e-47c1-8a38-c76634904b70 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088608 Sep 01 08:30:21.620210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1875/3722] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:21 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:22.474615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:22.475229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:22.481242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:22.481722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:22.482156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:22.482869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:22.483328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:22.483753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:22.530137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:22.530768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:22.537601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:22.538068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:22.538561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:22.539244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:22.539686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:22.540095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:22.551371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:22.559820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d09e1f64-898f-4723-9cba-3ae74aa98f76 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089030 Sep 01 08:30:22.560392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1848/3723] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:22 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:22.601944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:22.609695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3a254e82-dd99-4ea4-9fca-2b42908202b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083258 Sep 01 08:30:22.610278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1876/3724] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:22 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:22.642803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:22.643420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:22.649412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:22.649889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:22.650343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:22.651025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:22.651486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:22.651892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:22.667419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:22.717526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:22.730020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1305c6a-3290-4bd5-847e-fda2eea98127 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091544 Sep 01 08:30:22.730833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1849/3725] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:22 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:23.580751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:23.581696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:23.587626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:23.588109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:23.588542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:23.589233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:23.589691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:23.590115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:23.630847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:23.631470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:23.637374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:23.637856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:23.638319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:23.639014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:23.639465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:23.639891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:23.652804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:23.660933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-46ceba2a-9e81-40d3-addc-8280d903cae4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084537 Sep 01 08:30:23.664923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1877/3726] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:23 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:23.700955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:23.708824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d94f800e-a833-4525-9fba-e515c2caad3b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081823 Sep 01 08:30:23.709469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1850/3727] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:23 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:23.760707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:23.761229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:23.767367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:23.767839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:23.768267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:23.768943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:23.769384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:23.769797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:23.830716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:23.838439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3de750ee-a3bb-4815-b471-3c97b5a78370 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081795 Sep 01 08:30:23.839002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1878/3728] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:23 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:24.681959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:24.682580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:24.688791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:24.689267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:24.689695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:24.690397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:24.690841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:24.691258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:24.728855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:24.729413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:24.736014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:24.736484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:24.736914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:24.737603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:24.738048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:24.738485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:24.753006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:24.760903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70c91ee6-1ab6-4d95-8015-8fb9f72f59b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082727 Sep 01 08:30:24.761652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1851/3729] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:24 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:24.811353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:24.821838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a5ed39a5-db54-48fb-b776-bb59695b057e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.096758 Sep 01 08:30:24.822566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1879/3730] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:24 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:24.859726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:24.860567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:24.866780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:24.867262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:24.867693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:24.868386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:24.868830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:24.869254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:24.931879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:24.939802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ff6f34cb-e74b-460a-9c38-d0d1896dde19 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083861 Sep 01 08:30:24.940382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1852/3731] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:24 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:25.781113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:25.782473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:25.789048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:25.789652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:25.790141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:25.790890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:25.791640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:25.792068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:25.843139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:25.843747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:25.850044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:25.850547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:25.850978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:25.851660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:25.852106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:25.852558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:25.861350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:25.868946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b7fd692-d16c-4107-b9de-ce82f678d0f2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.091818 Sep 01 08:30:25.869751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1880/3732] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:25 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:25.916259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:25.924600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2ce9c03d-bd78-4c69-b21d-e802cdf3d0b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085244 Sep 01 08:30:25.925175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1853/3733] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:25 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:25.960371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:25.960991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:25.966919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:25.967420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:25.967841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:25.968509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:25.969453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:25.969865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:26.030983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:26.039271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd62af09-b2cc-4c1e-98d5-999fb70bbb2e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082808 Sep 01 08:30:26.039766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1881/3734] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:25 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:26.890809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:26.892020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:26.898193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:26.898730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:26.899168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:26.899921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:26.900313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:26.900738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:26.945263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:26.945858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:26.951711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:26.952186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:26.952617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:26.953347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:26.954500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:26.955058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:26.962546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:26.970361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4415c73e-3e12-4841-a384-cf70ddc6739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083191 Sep 01 08:30:26.970938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1854/3735] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:26 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:27.014689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:27.022762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-092c5a41-970d-43d9-8f4b-eed960c3b5f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081417 Sep 01 08:30:27.023315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1882/3736] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:26 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:27.060364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:27.060965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:27.067955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:27.068457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:27.068886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:27.069557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:27.070077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:27.070512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:27.130683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:27.138143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fa42d65e-09d3-4464-8013-848b7ba4bec7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.081624 Sep 01 08:30:27.138723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1855/3737] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:27 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:27.991342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:27.992051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:27.998058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:27.998579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:27.999027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:27.999694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:28.000170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:28.000757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:28.042905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:28.043511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:28.049576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:28.050061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:28.050529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:28.051224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:28.051669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:28.052089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:28.069055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:28.077043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-84ebb112-6efc-4072-b450-d952a35f2c51 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089655 Sep 01 08:30:28.077612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1883/3738] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:27 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:28.113185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:28.120866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-267b09b0-3259-4173-8a9b-564d14495936 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081758 Sep 01 08:30:28.121423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1856/3739] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:28 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:28.159237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:28.159835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:28.165722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:28.166210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:28.166672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:28.167340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:28.167780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:28.168199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:28.229077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:28.236842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7fbdc750-ee38-4cb6-9876-0cba29798cc8 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082390 Sep 01 08:30:28.237394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1884/3740] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:28 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:29.099767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:29.100661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:29.107048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:29.107568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:29.108323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:29.109323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:29.110390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:29.110825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:29.142129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:29.143358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:29.149935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:29.150443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:29.150872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:29.151564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:29.152002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:29.152415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:29.175326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:29.184619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e6582a0-e90a-4f9e-9ad1-c93bfd5103b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088730 Sep 01 08:30:29.185385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1857/3741] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:29 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:29.224561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:29.235296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ce349d9-380b-4889-872f-a3f973422f5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.096835 Sep 01 08:30:29.236059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1885/3742] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:29 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:29.257411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:29.258540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:29.264530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:29.265015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:29.265445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:29.266707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:29.267260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:29.267810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:29.332361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:29.344971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-085786fb-6b18-4b08-8895-f4c6ef55d5d6 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090344 Sep 01 08:30:29.345762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1858/3743] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:29 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:30.205731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:30.206709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:30.212751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:30.213436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:30.213859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:30.214747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:30.215196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:30.215607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:30.264808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:30.265538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:30.272453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:30.273010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:30.273507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:30.274269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:30.274807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:30.275315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:30.286049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:30.295244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-97f70658-9ebc-471a-9ae5-709f58ec689d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.093970 Sep 01 08:30:30.295840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1886/3744] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:30 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:30.336501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:30.344685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c0294763-41ee-436c-8e5f-5e1db50afb93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083193 Sep 01 08:30:30.345238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1859/3745] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:30 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:30.371980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:30.372691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:30.379633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:30.380140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:30.380604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:30.381334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:30.381730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:30.382154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:30.446099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:30.454516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3b68b01d-a1fb-4aef-89f6-14dbbd56b901 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086484 Sep 01 08:30:30.455076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1887/3746] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:30 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:31.316571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:31.317165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:31.324306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:31.324792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:31.325224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:31.325921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:31.326394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:31.326815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:31.365346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:31.365959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:31.367848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:31.373843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:31.374465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:31.374799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:31.376311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:31.376758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:31.377168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:31.390084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:31.398752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-23f2c62d-38b1-4d62-86da-3381181c77d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086530 Sep 01 08:30:31.399320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1860/3747] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:31 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:31.441747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:31.449474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-becb1bfc-5db9-4d6b-b778-ef0defdce33f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088256 Sep 01 08:30:31.450035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1888/3748] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:31 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:31.476658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:31.477552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:31.483658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:31.484133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:31.485188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:31.485978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:31.486462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:31.486878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:31.546676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:31.554843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-58b089a5-0be5-486c-b0e7-cc4ebed87ada tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.082494 Sep 01 08:30:31.555409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1861/3749] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:31 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:32.418956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:32.419557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:32.425744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:32.426223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:32.426683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:32.427376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:32.427828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:32.428247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:32.471273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:32.471866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:32.477828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:32.478338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:32.478799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:32.479515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:32.479961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:32.480375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:32.492928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:32.500995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9c98836a-b3f7-4eb7-adb1-687e8add551d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085609 Sep 01 08:30:32.501681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1889/3750] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:32 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:32.543873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:32.552147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f51dc10d-f031-4622-bf48-10c276aa3840 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085308 Sep 01 08:30:32.552717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1862/3751] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:32 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:32.575439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:32.576088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:32.583399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:32.583625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:32.584058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:32.584749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:32.585200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:32.585620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:32.590765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:32.648879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:32.657308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-215ea14d-53ee-4f79-aec3-c9f687eb9b17 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084919 Sep 01 08:30:32.657863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1890/3752] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:32 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:33.521793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:33.522444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:33.528838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:33.529334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:33.529771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:33.530531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:33.530983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:33.532050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:33.573095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:33.573742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:33.580323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:33.580810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:33.581617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:33.582363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:33.582814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:33.583236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:33.597173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:33.607266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0725244f-272c-4b9d-b46a-adfaadd7f8d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089227 Sep 01 08:30:33.607848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1863/3753] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:33 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:33.648682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:33.657058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3f5adef1-a48c-4fd4-bb6c-04d6197fe4fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087634 Sep 01 08:30:33.657429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1891/3754] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:33 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:33.677506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:33.678103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:33.684059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:33.684528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:33.684952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:33.685615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:33.686055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:33.686524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:33.746798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:33.754288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24c27494-0618-4813-ae15-7f94d9b2b1e4 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.080621 Sep 01 08:30:33.754840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1864/3755] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:33 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:34.628471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:34.629071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:34.634995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:34.635470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:34.635895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:34.636570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:34.637013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:34.637431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:34.676993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:34.677755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:34.679517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:34.685355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:34.685823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:34.686273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:34.686963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:34.687404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:34.688008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:34.702532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:34.711361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d533ac9d-cb56-40b6-bf36-ed4cbbfe8c14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086957 Sep 01 08:30:34.711943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1892/3756] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:34 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:34.756540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:34.764276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cd660d63-e002-4d1f-8017-0708e2d92b48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.091061 Sep 01 08:30:34.764847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1865/3757] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:34 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:34.774474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:34.775183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:34.781237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:34.782518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:34.783028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:34.783722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:34.784164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:34.784580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:34.847732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:34.855380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25d54526-a5bd-464a-bf85-8f28069c257a tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084754 Sep 01 08:30:34.855943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1893/3758] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:34 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:35.733261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:35.733823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:35.739988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:35.740464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:35.740919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:35.741595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:35.742037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:35.742494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:35.745078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:35.785273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:35.786129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:35.792227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:35.792712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:35.794920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:35.794920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:35.794920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:35.794920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:35.811565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:35.821871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-92312492-8875-4081-b3d0-52535f1c9288 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.092451 Sep 01 08:30:35.822608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1866/3759] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:35 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:35.862338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:35.870295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d3963b0-ae14-43bb-bb23-9d372bb07cff tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088993 Sep 01 08:30:35.871080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1894/3760] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:35 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:35.877865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:35.878915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:35.885121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:35.885599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:35.886028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:35.886744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:35.887194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:35.887606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:35.949152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:35.957628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-92cbaac8-1e4e-4546-ab9d-14a4b991043b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.084416 Sep 01 08:30:35.958184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1867/3761] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:35 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:36.844944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:36.845722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:36.851503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:36.851972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:36.852400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:36.853306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:36.853752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:36.854164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:36.898644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:36.899327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:36.906480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:36.906970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:36.907449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:36.908187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:36.908639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:36.909061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:36.935305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:36.944219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-419e435a-ccba-4d70-8bd5-ba51d455e188 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.103042 Sep 01 08:30:36.944802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1895/3762] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:36 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:36.974566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:36.978211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:36.978854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:36.983755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-52633ac0-9e83-410b-a347-f519f824c8ab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088631 Sep 01 08:30:36.984341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1868/3763] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:36 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:36.985987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:36.986676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:36.987111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:36.987824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:36.988277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:36.988694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:37.049928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:37.057548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8872a5fa-f003-44a2-ac53-a05727cec2fe tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.083118 Sep 01 08:30:37.058110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1896/3764] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:36 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:37.966915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:37.967589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:37.974124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:37.974639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:37.975075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:37.975769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:37.976221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:37.976652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:38.005529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:38.006167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:38.012284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:38.012764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:38.013187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:38.013872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:38.014337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:38.014754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:38.041238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:38.049391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-341f6521-0b71-4bcd-87c1-8e3255e52c08 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086275 Sep 01 08:30:38.049980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1869/3765] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:37 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:38.079888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:38.080494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:38.086712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:38.090068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:38.090945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:38.091374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:38.092115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:38.092584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:38.093000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:38.096584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c9e523ce-352d-459f-b571-bd5ef7cdb915 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.095520 Sep 01 08:30:38.097191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1897/3766] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:37 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:38.155688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:38.163830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ce28c3f3-0a68-453e-9769-95466d697b20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088307 Sep 01 08:30:38.164391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1870/3767] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:38 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:39.070076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:39.070708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:39.076781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:39.077270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:39.077699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:39.078420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:39.078870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:39.079810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:39.117326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:39.118006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:39.124474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:39.124953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:39.125389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:39.126521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:39.126995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:39.127480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:39.147180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:39.155512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-58b98c51-b46d-48d9-9cfd-d6dbe9e61278 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089319 Sep 01 08:30:39.156198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1898/3768] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:39 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:39.189163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:39.190252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:39.198870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:39.201026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:39.201889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:39.202991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:39.205156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:39.206599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:39.207417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:39.208116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70008842-5728-4bd8-a2fd-3a270c6e4743 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.094697 Sep 01 08:30:39.208923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1871/3769] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:39 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:39.287259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:39.295616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-639ec460-d579-48af-995d-61a5a7fd96cd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.113918 Sep 01 08:30:39.296187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1899/3770] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:39 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:40.181027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:40.181653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:40.187739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:40.188224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:40.188666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:40.189420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:40.189876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:40.190318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:40.229564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:40.230166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:40.241113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:40.241604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:40.242030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:40.242967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:40.243227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:40.243641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:40.256045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:40.263997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7953a3ba-28f7-42b9-b2e5-b115c142e0b7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086788 Sep 01 08:30:40.264690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1872/3771] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:40 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:40.316023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:40.316629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:40.322977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:40.323467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:40.323899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:40.324609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:40.325055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:40.325469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:40.331713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:40.340357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d736f3c-94c4-4685-9013-98741e78080f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.114513 Sep 01 08:30:40.340948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1900/3772] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:40 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:40.394157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:40.406032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2c8dea3-9d3c-42c7-aaa8-f18d3ee57152 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.093716 Sep 01 08:30:40.406646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1873/3773] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:40 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:41.294149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:41.294788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:41.300848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:41.301333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:41.301753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:41.302467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:41.302916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:41.303338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:41.362327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:41.363393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:41.366813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:41.370309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:41.370820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:41.371230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:41.371908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:41.372346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:41.372772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:41.374557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41518fcf-1614-4e54-96f1-7fd14b2cfe0e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084188 Sep 01 08:30:41.375361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1901/3774] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:41 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:41.427945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:41.428548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:41.435247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:41.435808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:41.436142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:41.436842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:41.437288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:41.437973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:41.441665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:41.452710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0caa5395-ad7b-41f2-a5ec-86faceb3a880 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.094363 Sep 01 08:30:41.453407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1874/3775] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:41 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:41.527695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:41.536051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d18a58e9-9917-4941-8b5b-a1fcd703344b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.111874 Sep 01 08:30:41.536641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1902/3776] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:41 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:42.394988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:42.395614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:42.401555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:42.402062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:42.402513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:42.403197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:42.403641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:42.404090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:42.468353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:42.477437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:42.477971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a513b8e2-1a8f-480d-9d2b-58e138035c4f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086875 Sep 01 08:30:42.478133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:42.478402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1875/3777] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:42 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:42.484607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:42.485085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:42.485970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:42.486714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:42.487165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:42.487586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:42.550711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:42.558366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f7700a28-0f83-45a6-8256-b2a781e1b09d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085924 Sep 01 08:30:42.558933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1903/3778] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:42 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:42.568034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:42.569377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:42.577249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:42.577883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:42.578481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:42.580034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:42.580490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:42.581168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:42.646496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:42.654449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c66eb3f-3dab-4843-8021-feb2e0ae73ed tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.091989 Sep 01 08:30:42.655037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1876/3779] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:42 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:43.499632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:43.500252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:43.506467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:43.506946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:43.507374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:43.508055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:43.508497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:43.508911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:43.571756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:43.580769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23c572ba-d04c-44b7-9009-be35261a56c1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084228 Sep 01 08:30:43.581745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1904/3780] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:43 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:43.582176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:43.583091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:43.589339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:43.589848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:43.590298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:43.590994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:43.591450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:43.591873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:43.655179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:43.663765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ca2275a8-c557-4933-8e30-145c8d578e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088516 Sep 01 08:30:43.664342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1877/3781] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:43 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:43.675992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:43.676701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:43.688414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:43.688913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:43.690675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:43.691419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:43.691875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:43.692302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:43.907520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:43.916105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b0c0a28-929c-4ff4-ab32-64d8175545ba tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.243881 Sep 01 08:30:43.917083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1905/3782] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:43 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:44.601599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:44.602195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:44.608210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:44.608676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:44.609105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:44.609786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:44.610234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:44.610677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:44.673825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:44.681838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-81458bf0-8f4e-47c4-85b7-e08df197ce34 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083817 Sep 01 08:30:44.682241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1878/3783] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:44 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:44.684794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:44.685410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:44.696445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:44.696927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:44.697496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:44.698061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:44.698546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:44.698999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:44.761530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:44.764881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:44.771122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-06e10559-b8cf-4369-a05a-1c1e32d4686b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090266 Sep 01 08:30:44.771690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1906/3784] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:44 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:44.937167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:44.937774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:44.947178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:44.947662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:44.948093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:44.948785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:44.949230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:44.949650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:45.023064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:45.030802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-45785aaf-a22b-48c8-863a-7196bd1aac8e tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.097467 Sep 01 08:30:45.031360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1879/3785] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:44 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:45.703464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:45.704209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:45.710663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:45.711146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:45.711581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:45.712277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:45.712727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:45.713149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:45.777177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:45.787779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd305987-d21d-48d2-ab58-8baf0c1764e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088315 Sep 01 08:30:45.788349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1907/3786] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:45 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:45.791587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:45.792270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:45.798357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:45.799578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:45.800093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:45.800857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:45.801376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:45.801865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:45.862528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:45.871202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fdc07e5e-9a9f-4dc4-9d73-1f33f14f6c95 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083400 Sep 01 08:30:45.871759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1880/3787] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:45 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:46.052105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:46.052742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:46.059184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:46.059691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:46.060123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:46.060818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:46.061264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:46.061713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:46.131593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:46.144282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f9eb18f-b18b-42de-9492-f3f0839259d1 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.096483 Sep 01 08:30:46.145235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1908/3788] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:46 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:46.814357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:46.815591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:46.821852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:46.822383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:46.822820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:46.823510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:46.823958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:46.824380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:46.893517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:46.894342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:46.894952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:46.901545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:46.902050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aafea261-0308-4855-a4bb-44c41c9193ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.091504 Sep 01 08:30:46.902968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1881/3789] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:46 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:46.904087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:46.904493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:46.905223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:46.905710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:46.906137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:46.973173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:46.981186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bc324e28-3759-4d44-97ef-f441c9eaf587 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.091980 Sep 01 08:30:46.981746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1909/3790] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:46 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:47.168327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:47.168852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:47.176475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:47.176959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:47.177383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:47.178073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:47.178657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:47.179073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:47.244316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:47.246530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:47.253352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ac7b2a65-d50b-407d-a2a4-b74e697d9ee0 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.089807 Sep 01 08:30:47.253916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1882/3791] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:47 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:47.922284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:47.923079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:47.929937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:47.930485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:47.930919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:47.931610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:47.932059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:47.932479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:48.003437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:48.004145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:48.010591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:48.011074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:48.011700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:48.012554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:48.013413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:48.013594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:48.172758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:48.183527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-81e79f85-4a98-4de4-b7e8-0dc000c73932 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.264972 Sep 01 08:30:48.184330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1910/3792] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:47 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:48.229424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:48.238101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-36370d41-0df4-4639-b9f0-32524a4bdb73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.240254 Sep 01 08:30:48.238773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1883/3793] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:47 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:48.274485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:48.275097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:48.281430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:48.281916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:48.282395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:48.283161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:48.284639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:48.285072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:48.348484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:48.356204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3b4982e6-681e-4949-9353-00a2768a4c20 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085887 Sep 01 08:30:48.356768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1911/3794] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:48 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:49.204915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:49.206429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:49.212875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:49.213359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:49.213855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:49.214593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:49.215042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:49.215465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:49.259172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:49.260001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:49.266202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:49.266792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:49.267146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:49.267905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:49.268633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:49.269159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:49.289560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:49.297396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-494c4239-606c-481b-96d0-e3f64aab4e73 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.096243 Sep 01 08:30:49.302306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1884/3795] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:49 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:49.333283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:49.341091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1f99659c-4630-4663-b09e-908344087525 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085764 Sep 01 08:30:49.341849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1912/3796] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:49 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:49.376265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:49.376870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:49.384260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:49.384739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:49.385170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:49.385868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:49.386386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:49.386818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:49.451213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:49.459444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cd2743e7-299d-498b-8850-9d1926e75cb5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.086940 Sep 01 08:30:49.460050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1885/3797] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:49 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:50.320571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:50.321178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:50.327398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:50.328005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:50.328542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:50.329323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:50.329839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:50.330471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:50.363307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:50.363935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:50.370373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:50.370786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:50.371222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:50.371921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:50.372369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:50.372796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:50.401607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:50.414081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c4f20f14-a34a-48df-9b23-b81613d7c5ad tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.097648 Sep 01 08:30:50.414976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1913/3798] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:50 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:50.452745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:50.461979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fc588027-4844-40de-9c1b-39bad1c5e3a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.103786 Sep 01 08:30:50.462591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1886/3799] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:50 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:50.481868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:50.482670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:50.488892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:50.489383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:50.489808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:50.490530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:50.490975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:50.491396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:50.557002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:50.565655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a3985e4-dace-41ed-9b40-c814e0a8212b tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088684 Sep 01 08:30:50.566391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1914/3800] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:50 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:51.434952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:51.435562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:51.443286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:51.443772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:51.444205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:51.444900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:51.445721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:51.446150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:51.483667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:51.484409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:51.491817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:51.492286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:51.492715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:51.493408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:51.493850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:51.494284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:51.513397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:51.522728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3f875df5-832e-43ff-ad30-d008bfb79c89 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.091499 Sep 01 08:30:51.523488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1887/3801] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:51 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:51.562029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:51.571308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52174b18-d4ac-42ed-af40-eead37670e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.091583 Sep 01 08:30:51.571894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1915/3802] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:51 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:51.590834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:51.591579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:51.598619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:51.599192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:51.599707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:51.600458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:51.600900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:51.601313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:51.668912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:51.676906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b436497-680c-4b13-9fef-8177c28b0cd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.092520 Sep 01 08:30:51.677469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1888/3803] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:51 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:52.543805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:52.544705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:52.551632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:52.552114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:52.552543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:52.553224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:52.553673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:52.554087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:52.595071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:52.595697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:52.602567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:52.603231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:52.603678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:52.604379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:52.604827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:52.605243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:52.639197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:52.648282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9a383742-2015-4e93-9a84-c36bbf5995af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.108298 Sep 01 08:30:52.648898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1916/3804] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:52 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:52.695714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:52.696830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:52.697430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:52.703159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-14bda2bd-c58d-4341-ae54-884c774e14c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.111821 Sep 01 08:30:52.703470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:52.706313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:52.706516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1889/3805] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:52 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:52.706637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:52.706637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:52.706637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:52.706637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:52.769403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:52.778798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-701f9459-c945-4884-90b7-78e0728c9aa7 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085337 Sep 01 08:30:52.779368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1917/3806] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:52 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:53.669044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:53.669656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:53.676394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:53.676971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:53.677394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:53.678067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:53.678534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:53.678947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:53.725331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:53.726016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:53.732899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:53.733384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:53.733882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:53.734685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:53.735205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:53.735702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:53.748701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:53.757385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a40274ee-a91e-4cdb-9e92-d72ca68df509 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.092172 Sep 01 08:30:53.758281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1890/3807] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:53 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:53.799380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:53.800298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:53.803934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:53.806564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:53.807054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:53.807485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:53.808176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:53.808635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:53.809040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:53.812451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0e3fe191-5e93-4fb7-b196-e91e13d92e1e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092007 Sep 01 08:30:53.813249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1918/3808] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:53 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:53.873402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:53.885837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a59073e-a06b-4031-b956-d61b00e83ec9 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.090383 Sep 01 08:30:53.886443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1891/3809] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:53 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:54.778661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:54.779219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:54.786131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:54.786631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:54.787057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:54.787759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:54.788183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:54.788596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:54.834457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:54.835086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:54.841187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:54.842353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:54.842826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:54.843967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:54.844430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:54.844859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:54.850185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:54.857773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16e7c4c4-9366-40df-86cc-9f15d780d86e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083058 Sep 01 08:30:54.858356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1919/3810] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:54 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:54.907956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:54.909310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:54.912219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:54.915502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:54.916069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:54.916594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:54.917304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:54.917749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:54.918169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:54.919820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f2102151-4ad0-415e-b91d-1b73e73ea505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090524 Sep 01 08:30:54.920370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1892/3811] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:54 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:54.983736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:54.992070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-df51c619-617c-45fe-898a-eadc4db6ae59 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.088229 Sep 01 08:30:54.992641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1920/3812] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:54 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:55.878771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:55.879426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:55.885498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:55.885975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:55.886839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:55.887522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:55.887966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:55.888383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:55.941704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:55.942342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:55.949095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:55.949570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:55.949999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:55.950707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:55.951151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:55.951569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:55.960181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:55.967900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-191712f3-63db-4584-b116-8bd8870e1d14 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.093169 Sep 01 08:30:55.968764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1893/3813] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:55 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:56.013373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:56.013712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:56.014716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:56.021927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38228132-f715-450b-8496-17d8cf9f0842 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084663 Sep 01 08:30:56.022173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:56.022495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:56.022849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1921/3814] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:55 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:56.023000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:56.023649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:56.024102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:56.024526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:56.094742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:56.103303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f6935a3-7462-48d7-81f8-1c19d75b992f tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.093797 Sep 01 08:30:56.103859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1894/3815] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:56 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:56.989035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:56.989736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:56.995667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:56.996143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:56.996571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:56.997257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:56.997692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:56.998104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:57.045975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:57.047092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:57.058357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:57.059209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:57.059990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:57.061212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:57.062015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:57.062821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:57.071297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:57.078939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e8e2549-5edb-4796-aeed-a40acdd80dac tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.094295 Sep 01 08:30:57.079502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1922/3816] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:56 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:57.123403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:57.124031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:57.129305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:57.131162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:57.131647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:57.132074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:57.132765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:57.133209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:57.133621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:57.137247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-76bbedf9-017b-4a51-937b-4a9130ca978d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.097892 Sep 01 08:30:57.137898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1895/3817] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:57 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:57.153804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:57.197179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:57.204730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65d51684-a6f3-4519-a897-a2f11f8c2811 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085456 Sep 01 08:30:57.205297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1923/3818] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:57 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:58.100561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:58.101186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:58.107315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:58.107790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:58.108213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:58.108893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:58.109334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:58.109897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:58.159856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:58.160768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:58.166760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:58.167354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:58.167853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:58.168615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:58.169093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:58.169514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:58.175597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:58.183179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f350b5eb-3a57-48c2-b1f3-e8845386d94e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086929 Sep 01 08:30:58.183715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1896/3819] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:58 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:58.226804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:58.227407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:58.231947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:58.233540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:58.234019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:58.234477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:58.235165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:58.235617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:58.236029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:58.241606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9c4c92d9-e6b2-4a26-8f1e-c2ae2d893c5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086347 Sep 01 08:30:58.242412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1924/3820] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:58 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:58.301217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:58.308873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-99a9d0ae-306e-4e6e-aa1b-2485e81ed3b5 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085968 Sep 01 08:30:58.309434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1897/3821] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:58 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:59.204614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:59.205227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:59.212099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:59.212586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:59.213016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:59.213701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:59.214149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:59.214589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:59.264538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:59.265148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:59.272537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:59.273054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:59.273493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:59.274397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:59.274927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:59.275359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:59.276116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:59.283782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6cd46d39-d9b8-4a9d-ac7b-cc05c866739c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083077 Sep 01 08:30:59.284963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1925/3822] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:59 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:30:59.329122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:30:59.329727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:30:59.336974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:59.337453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:59.337884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:59.338607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:30:59.339058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:30:59.339469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:30:59.340494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:59.348940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e87e8b91-e1d4-4e81-a44d-ed2397126e58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088244 Sep 01 08:30:59.349543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1898/3823] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:59 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:30:59.403699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:30:59.412591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e94a22ea-21f0-4b64-ba11-f2747e4b6b94 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.087258 Sep 01 08:30:59.413162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1926/3824] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:30:59 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:00.305428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:00.306044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:00.312089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:00.312565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:00.312994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:00.313677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:00.314120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:00.314562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:00.329663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:00.369052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:00.369659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:00.375849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:00.376275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:00.376437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:00.376737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:00.377413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:00.377875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:00.378312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:00.384552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6cee6b9c-7588-410d-b861-ed80d9c37487 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082927 Sep 01 08:31:00.385104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1899/3825] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:00 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:00.433038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:00.433762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:00.441540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:00.441736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:00.443513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:00.444432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:00.445160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:00.445616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:00.446037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:00.449610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0220ff60-cad5-417f-a8ac-3757effb3278 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084411 Sep 01 08:31:00.450185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1927/3826] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:00 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:00.522686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:00.530249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5c2f8bd1-0000-4380-9beb-030f15e5fcd3 tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.101098 Sep 01 08:31:00.530833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1900/3827] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:00 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:01.405828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:01.406473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:01.408422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=80 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:01.413837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.414349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.414786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.415477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.415927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.416355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.470970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:01.471737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:01.478064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:01.478678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.479228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.479736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.480514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.480955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.481369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.485566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac677728-b640-4ad8-a085-18f9261fd96b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083582 Sep 01 08:31:01.486124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1928/3828] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:01 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:01.543149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:01.551335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:01.551943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:01.552119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aa3d5e5e-92d5-4693-a09a-7a1e729198d6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084955 Sep 01 08:31:01.552693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1901/3829] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:01 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:01.558060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.558583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.559017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.559707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.560155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.560573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.624155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd713712c30574895b82beedb9c4f251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d7e2503aa043929798769c22c1b2da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:01.632446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7e9443b-7fb6-44c1-bc10-30ec733da84c tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 200 len: 1223 microversion: 2.1 time: 0.085786 Sep 01 08:31:01.633011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1929/3830] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:01 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:01.651612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:01.652104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:01.658169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.658610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.659045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.659716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.660158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.660572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.685362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:31:01.695032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:01.695499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:01.695923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:01.708811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lazy-loading 'flavor' on Instance uuid 7a124994-73d1-4fd9-bfab-03e4a568159d {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:31:01.719633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lazy-loading 'system_metadata' on Instance uuid 7a124994-73d1-4fd9-bfab-03e4a568159d {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:31:01.735417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lazy-loading 'metadata' on Instance uuid 7a124994-73d1-4fd9-bfab-03e4a568159d {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:31:01.752083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR oslo.messaging._drivers.impl_rabbit [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [4f484b97-1284-42a0-80ff-27eb1ba8995d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 08:31:02.506940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:02.507603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:02.513433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:02.513936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:02.514399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:02.515098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:02.515545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:02.515964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:02.588119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:02.595884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6dd37b36-96cd-4c26-bc64-de5d028e031c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.093352 Sep 01 08:31:02.597325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1930/3831] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:02 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:02.601719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:02.602342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:02.608145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:02.608587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:02.609022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:02.609734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:02.610154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:02.610634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:02.672631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:02.681243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6a5ed11b-b967-414d-8bda-3313457b303b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082915 Sep 01 08:31:02.682497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1931/3832] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:02 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:02.758983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [4f484b97-1284-42a0-80ff-27eb1ba8995d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 53128. Sep 01 08:31:02.854679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Deleted allocations for instance 7a124994-73d1-4fd9-bfab-03e4a568159d Sep 01 08:31:02.879878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-baf56d32-eff2-471e-bd6c-5a1b82dd07ca tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 204 len: 0 microversion: 2.1 time: 1.231900 Sep 01 08:31:02.880501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1902/3833] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:31:01 2022] DELETE /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 0 bytes in 1233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:31:02.889301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:02.889896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] [instance: 7a124994-73d1-4fd9-bfab-03e4a568159d] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:02.896491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:02.896970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:02.897391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:02.898076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:02.898547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:02.899613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:02.913181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] HTTP exception thrown: Instance 7a124994-73d1-4fd9-bfab-03e4a568159d could not be found. Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Request method failure captured: Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d HTTP/1.1 Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEGrp95DNXTaENj1SEcTN7CWAN6Gejzun8V0WqDYttTUcwvw9UnXAxrfa_aojN07OHmKMTmwcfEIZmGuMxVhmm16GRrW-uPnaIz_JXH75CMRzszfhylVLOE7DOwRdzAn-mJIC1nWKTXfNhbJp5Y0ugssn85xRSVARnx1ozTP4_x8Qt6g Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 82d7e2503aa043929798769c22c1b2da Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1497783886 Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:31:02.914744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7e2503aa043929798769c22c1b2da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7e2503aa043929798769c22c1b2da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82d7e2503aa043929798769c22c1b2da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82d7e2503aa043929798769c22c1b2da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesSnapshotTestJSON-1497783886 Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 82d7e2503aa043929798769c22c1b2da Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1497783886 Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesSnapshotTestJSON-1497783886-project Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: d713712c30574895b82beedb9c4f251d Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesSnapshotTestJSON-1497783886-project Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance 7a124994-73d1-4fd9-bfab-03e4a568159d could not be found. Sep 01 08:31:02.916674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '7a124994-73d1-4fd9-bfab-03e4a568159d'} Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a124994-73d1-4fd9-bfab-03e4a568159d could not be found. Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:31:02.917626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a124994-73d1-4fd9-bfab-03e4a568159d could not be found. Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a124994-73d1-4fd9-bfab-03e4a568159d could not be found. Sep 01 08:31:02.919183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:31:02.920485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] Returning 404 to user: Instance 7a124994-73d1-4fd9-bfab-03e4a568159d could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:31:02.920485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4f453c4-df01-4934-9e00-5f7bcc5923dd tempest-VolumesSnapshotTestJSON-1497783886 tempest-VolumesSnapshotTestJSON-1497783886-project] 10.222.0.43 "GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d" status: 404 len: 111 microversion: 2.1 time: 0.030680 Sep 01 08:31:02.920485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1932/3834] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:02 2022] GET /compute/v2.1/servers/7a124994-73d1-4fd9-bfab-03e4a568159d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:31:03.618561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:03.619238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:03.625255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:03.625734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:03.626160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:03.626872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:03.627325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:03.628368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:03.692388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:03.700188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b73f413d-6883-4291-9e71-1b474d3e8970 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085866 Sep 01 08:31:03.700742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1903/3835] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:03 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:03.702141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:03.702789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:03.709530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:03.710052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:03.710518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:03.711201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:03.711651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:03.712113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:03.774759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:03.782669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3bf6e5ec-6c3f-48c3-b243-c1f52ccf076f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084192 Sep 01 08:31:03.783216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1933/3836] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:03 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:04.721185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:04.721823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:04.723666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:04.729345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:04.729831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:04.730291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:04.730970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:04.731419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:04.731835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:04.797285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:04.804037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:04.804731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:04.805690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-01138ad4-1e92-4dde-b4bd-5d5ab7cd76d6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088456 Sep 01 08:31:04.806247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1904/3837] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:04 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:04.810708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:04.811186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:04.811620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:04.812329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:04.812778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:04.813199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:04.884466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:04.892293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2df1dab1-0aa7-42cd-9de0-1e90e59e52a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092629 Sep 01 08:31:04.892858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1934/3838] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:04 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:05.827081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:05.827701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:05.834550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:05.835036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:05.835470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:05.836158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:05.836607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:05.837025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:05.898386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:05.906115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d5360441-5527-4375-b552-d6c5611297e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082853 Sep 01 08:31:05.906706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1905/3839] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:05 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:05.912727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:05.913331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:05.919241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:05.919710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:05.920138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:05.920800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:05.921239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:05.921651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:05.988485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:05.996536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9322ef03-9189-4794-9ac0-4421b47a8ebe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087547 Sep 01 08:31:05.998607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1935/3840] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:05 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:06.925955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:06.926596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:06.932643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:06.933124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:06.933555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:06.934253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:06.934742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:06.935144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:06.998864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:07.006455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b4d0392f-8912-4049-a844-4abc2e46b788 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084290 Sep 01 08:31:07.007062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1906/3841] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:06 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:07.016693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:07.017297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:07.023810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:07.024282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:07.024712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:07.025391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:07.025836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:07.026270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:07.089467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:07.097834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40266ce5-9f90-4997-a814-90a8295a4b8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084867 Sep 01 08:31:07.098419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1936/3842] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:07 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:08.031244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:08.033837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:08.039277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:08.039762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:08.040201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:08.040899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:08.041351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:08.041812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:08.104450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:08.111918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d41bffb9-e4a9-4301-861a-366fe4faf571 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088123 Sep 01 08:31:08.113401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1907/3843] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:08 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:08.118511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:08.119113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:08.124970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:08.125441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:08.125865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:08.126569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:08.127007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:08.127422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:08.188491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:08.196226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-49eb8f06-b284-4175-888e-9b322476ab85 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081405 Sep 01 08:31:08.196795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1937/3844] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:08 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:09.133753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:09.134421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:09.140572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:09.141056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:09.141490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:09.142178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:09.142654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:09.143072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:09.207820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:09.215742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0beb8da1-1c72-41da-b8a5-83feff9ecfff tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085944 Sep 01 08:31:09.216300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1908/3845] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:09 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:09.216726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:09.217334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:09.223192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:09.223658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:09.224085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:09.224767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:09.225205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:09.225616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:09.285662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:09.293414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-70db93b9-7d1f-4740-bcb4-6b275c534baf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080374 Sep 01 08:31:09.293979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1938/3846] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:09 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:10.236341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:10.236937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:10.243122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:10.243608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:10.244048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:10.244743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:10.245284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:10.245706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:10.309302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:10.316773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:10.318745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5a00c87a-4e24-45b3-9dee-8b762d1993b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086188 Sep 01 08:31:10.319299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:10.319458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1909/3847] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:10 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:10.325670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:10.326150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:10.326618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:10.327308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:10.327759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:10.328178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:10.396067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:10.404712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a593e5c8-5f31-4e92-bb1e-5aa7ffeaa11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092803 Sep 01 08:31:10.416254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1939/3848] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:10 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:11.348776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:11.349880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:11.358687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:11.359170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:11.359609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:11.360301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:11.360749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:11.361172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:11.426570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:11.427014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:11.427240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:11.433317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:11.433803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:11.434238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:11.434695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-237a2bfd-c990-4231-a2af-12860ac13b99 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.093067 Sep 01 08:31:11.434954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:11.435647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:11.435820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1910/3849] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:11 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:11.436033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:11.504470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:11.507920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:11.513031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7cae283-55c6-4a6b-a8e4-641df7535af7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090324 Sep 01 08:31:11.513613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1940/3850] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:11 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:12.454991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:12.455846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:12.462115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:12.462632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:12.463067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:12.463757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:12.464204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:12.464623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:12.527287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:12.530713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:12.535141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:12.535854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:12.536255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-86bbb516-66e2-4fe2-87f6-de1d88616d9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085057 Sep 01 08:31:12.536825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1911/3851] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:12 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:12.542428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:12.542983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:12.543481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:12.544254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:12.544770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:12.545255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:12.609165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:12.617422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d506dc7-563e-48b2-aaa4-30439314921f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086954 Sep 01 08:31:12.617985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1941/3852] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:12 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:13.557586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:13.558197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:13.565495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:13.566205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:13.566661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:13.567352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:13.567797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:13.568211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:13.640696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:13.641104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:13.642757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:13.647470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:13.647954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:13.648389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:13.649079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:13.649530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:13.650089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:13.651490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-db652111-d78a-4ded-8f28-f55bd40b9a9d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.098363 Sep 01 08:31:13.652069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1912/3853] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:13 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:13.711406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:13.719492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-297cbc39-ade8-4059-b9cf-7c196d2c25c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085879 Sep 01 08:31:13.720069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1942/3854] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:13 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:14.673183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:14.673819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:14.680886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:14.681357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:14.681785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:14.682495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:14.682946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:14.683366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:14.741553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:14.742155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:14.748582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:14.756294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:14.756441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-69548ce0-8152-4f4b-a766-c8953faf7ffb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.087053 Sep 01 08:31:14.756786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:14.761301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:14.761692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1913/3855] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:14 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:14.761794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:14.761794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:14.761794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:14.824654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:14.841706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f7dcd38-4165-4e6d-a8cd-9882be03ba01 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.104601 Sep 01 08:31:14.842311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1943/3856] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:14 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:15.777126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:15.777700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:15.783682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:15.784792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:15.785230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:15.785924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:15.786396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:15.786812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:15.850472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:15.858231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f48285fa-91d7-42c2-a69c-2c1cd38e87a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084998 Sep 01 08:31:15.858880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1914/3857] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:15 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:15.862509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:15.863129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:15.868958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:15.869432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:15.869858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:15.870556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:15.871006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:15.871419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:15.932143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:15.939875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe3775dc-6a72-4736-bb24-ec0c64efd824 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081192 Sep 01 08:31:15.940468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1944/3858] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:15 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:16.879213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:16.879827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:16.885758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:16.886236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:16.886696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:16.887375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:16.887821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:16.888226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:16.948870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:16.957277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e23827dc-77e1-434a-a3b0-75490db3fc7c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082330 Sep 01 08:31:16.957983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1915/3859] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:16 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:16.961200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:16.961811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:16.967679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:16.968146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:16.968575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:16.969253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:16.969697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:16.970118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:17.038677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:17.046401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ab3b15e3-8b51-4864-8238-dd2259699137 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.089020 Sep 01 08:31:17.046977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1945/3860] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:16 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:17.977894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:17.978472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:17.984609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:17.985089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:17.985520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:17.986203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:17.986677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:17.987107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:18.052642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:18.060265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b7f964b-a728-432b-ad7d-9394649320c8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086386 Sep 01 08:31:18.060817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1916/3861] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:17 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:18.067096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:18.067705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:18.073592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:18.074066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:18.074541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:18.075223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:18.075667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:18.076083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:18.139787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:18.148218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09f7b533-6881-4dab-bb54-724a1f4cacdd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085071 Sep 01 08:31:18.148787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1946/3862] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:18 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:19.080793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:19.081361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:19.087330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:19.087791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:19.088221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:19.088900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:19.089347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:19.089763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:19.150043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:19.157626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e859aa7-0984-4363-9094-31f021ad4fb5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081065 Sep 01 08:31:19.158175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1917/3863] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:19 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:19.168644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:19.169244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:19.175324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:19.176634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:19.177076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:19.177761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:19.178208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:19.178653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:19.239702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:19.247462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-15c9a61c-6782-4983-99f3-f1eda9328c5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082435 Sep 01 08:31:19.248034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1947/3864] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:19 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:20.179520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:20.180145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:20.186065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:20.186573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:20.187008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:20.187688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:20.188142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:20.188564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:20.253818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:20.261394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-36b343c2-42e7-4743-9a85-3cbd92dba014 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086535 Sep 01 08:31:20.261957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1918/3865] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:20 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:20.267697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:20.268308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:20.274743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:20.275233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:20.275664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:20.276338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:20.276783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:20.277198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:20.339070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:20.348610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-48e464e5-f411-4971-bffd-6a8df34a3bfc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084573 Sep 01 08:31:20.349234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1948/3866] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:20 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:21.281719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:21.282361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:21.289086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:21.289569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:21.290006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:21.290727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:21.291172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:21.291594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:21.352970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:21.360542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4c1f2f67-9f33-49d6-8de2-3a04989dc438 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082625 Sep 01 08:31:21.361038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1919/3867] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:21 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:21.369436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:21.370037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:21.375864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:21.376333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:21.376755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:21.377426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:21.377867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:21.378299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:21.438198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:21.446102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-da6cb135-ef59-4688-b604-802165aea2aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080376 Sep 01 08:31:21.446715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1949/3868] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:21 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:22.381915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:22.382576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:22.388362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:22.388833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:22.389265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:22.389942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:22.390416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:22.390827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:22.454762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:22.463140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0d7726d-f42a-4c4e-976c-4cbf1f430169 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085215 Sep 01 08:31:22.463698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1920/3869] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:22 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:22.466681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:22.467293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:22.473848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:22.474383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:22.474997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:22.475686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:22.476130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:22.476565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:22.537680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:22.545373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6b8b5b3a-a795-45f4-860a-00396efd1e9d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082766 Sep 01 08:31:22.545940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1950/3870] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:22 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:23.485073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:23.485660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:23.492141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:23.492617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:23.493044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:23.493720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:23.494162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:23.494607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:23.555613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:23.563165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04e32742-e7da-4775-b8e0-0f4adfd605e5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081894 Sep 01 08:31:23.563878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1921/3871] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:23 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:23.566965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:23.567628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:23.573589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:23.574067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:23.574525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:23.577207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:23.577207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:23.577207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:23.638050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:23.646497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7fbf40cc-35da-4306-bc4c-0e092fdc8fca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083427 Sep 01 08:31:23.647074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1951/3872] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:23 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:24.584246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:24.585536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:24.591829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:24.592314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:24.592741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:24.593429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:24.594182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:24.594967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:24.656795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:24.665411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a69ed0db-3dc8-48e8-85fd-080c74a552e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085409 Sep 01 08:31:24.665992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1922/3873] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:24 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:24.678515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:24.678515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:24.678515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:24.678515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:24.679462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:24.679462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:24.679462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:24.679462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:24.742621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:24.751098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a91106ff-b45b-402b-b209-7c6b011846b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087230 Sep 01 08:31:24.751871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1952/3874] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:24 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:25.688599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:25.689207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:25.695875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:25.696361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:25.696809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:25.697479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:25.697928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:25.698378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:25.761117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:25.769087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e8230dfc-daa4-4c7e-be24-6c25179d9029 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084433 Sep 01 08:31:25.769645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1923/3875] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:25 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:25.781177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:25.781779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:25.790690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:25.791414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:25.791850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:25.792535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:25.792975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:25.793387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:25.859743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:25.867694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95b1cd91-da53-41cb-9d52-8ea640e07e28 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090186 Sep 01 08:31:25.868263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1953/3876] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:25 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:26.790812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:26.791426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:26.797648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:26.798123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:26.798592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:26.799266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:26.799715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:26.800126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:26.865833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:26.873868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ccefd068-2e89-4346-b153-dbf59875c839 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086458 Sep 01 08:31:26.874060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1924/3877] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:26 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:26.888669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:26.889262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:26.895183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:26.896217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:26.896646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:26.897318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:26.897759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:26.898176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:26.958979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:26.966777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee7200bc-6f88-44ea-8e65-311091d92ac0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081883 Sep 01 08:31:26.967348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1954/3878] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:26 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:27.895161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:27.895946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:27.901914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:27.902443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:27.902873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:27.903553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:27.904191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:27.904814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:27.966769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:27.975095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7e508aca-0f9a-4f2e-9aa6-af2808ee9b19 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083837 Sep 01 08:31:27.975648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1925/3879] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:27 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:27.987143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:27.987747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:27.996043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:27.996570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:27.998183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:27.998921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:27.999377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:27.999796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:28.061327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:28.069825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-07fb84b8-1790-46bc-9863-bab3b75c575f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086443 Sep 01 08:31:28.070420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1955/3880] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:27 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:28.996056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:28.996673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:29.002634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:29.003119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:29.003559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:29.004249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:29.005230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:29.005718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:29.090548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:29.091049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:29.091643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:29.097614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:29.098129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:29.098560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:29.098851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be532bd8-cfe6-4249-ba1d-15f200495fbb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.106373 Sep 01 08:31:29.099261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:29.099541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1926/3881] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:28 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:29.099696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:29.100155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:29.160495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:29.168376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e78fa00-ece1-4968-8c23-b5f59b989301 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081011 Sep 01 08:31:29.168950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1956/3882] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:29 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:30.120283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:30.121868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:30.127241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:30.127753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:30.128209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:30.128901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:30.129347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:30.130652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:30.189729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:30.190328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:30.196726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:30.197208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:30.197639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:30.198361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:30.198809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:30.199227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:30.210527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:30.218576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:30.219689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2ba1de92-0538-4564-b2a8-928cc76d0662 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.103404 Sep 01 08:31:30.220305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1927/3883] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:30 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:30.273983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:30.284411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf6c29fc-170f-4a11-88d3-ec506cf5183c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.098792 Sep 01 08:31:30.285237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1957/3884] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:30 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:31.247944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:31.248538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:31.254679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:31.255331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:31.255812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:31.256501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:31.256945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:31.257364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:31.275275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:31.307452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:31.308170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:31.314134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:31.314643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:31.315079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:31.315768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:31.316222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:31.316644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:31.320644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:31.328197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1356ced3-9d4a-41b1-9bad-8fcbf7f16abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084006 Sep 01 08:31:31.328706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1928/3885] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:31 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:31.378675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:31.386740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6841797f-6f7e-4e48-878c-f063dbff5e2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083091 Sep 01 08:31:31.387307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1958/3886] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:31 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:32.349954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:32.350644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:32.360964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:32.361441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:32.361874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:32.362605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:32.363061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:32.363502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:32.407814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:32.408577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:32.410545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=62 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:32.416654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:32.417209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:32.417702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:32.418478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:32.418994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:32.419413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:32.423991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:32.431533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5098f1f9-f92d-40a5-a16b-2554ab5c9a8a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086283 Sep 01 08:31:32.432100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1929/3887] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:32 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:32.482948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:32.491123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a3e329fd-aa81-479d-a24f-45a87d32e152 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087152 Sep 01 08:31:32.491702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1959/3888] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:32 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:33.452319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:33.453121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:33.459551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:33.460032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:33.460466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:33.461155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:33.461604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:33.462021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:33.511799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:33.512406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:33.518467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:33.518941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:33.519366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:33.520081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:33.520730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:33.521125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:33.526435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:33.534158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-597f379c-79b0-4765-9138-e27513399fc5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085773 Sep 01 08:31:33.534988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1930/3889] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:33 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:33.582450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:33.591981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-15c065f0-075e-4017-95ce-0b13fc11a84f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082563 Sep 01 08:31:33.591981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1960/3890] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:33 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:34.555302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:34.555933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:34.561890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:34.562402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:34.562831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:34.563512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:34.563959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:34.564373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:34.612023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:34.612725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:34.619284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:34.619840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:34.620345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:34.621100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:34.621553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:34.621970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:34.628434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:34.636887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4ef21b3a-42d6-48f4-b027-e487faad5ffa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085534 Sep 01 08:31:34.637668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1931/3891] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:34 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:34.684115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:34.691801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d36a7c4-c137-44e1-842c-d8d839376d9c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083545 Sep 01 08:31:34.693596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1961/3892] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:34 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:35.658288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:35.658906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:35.660910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=56 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:35.667061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:35.667556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:35.667990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:35.668689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:35.669141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:35.669569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:35.714607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:35.715237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:35.721446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:35.722057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:35.722468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:35.723239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:35.723692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:35.724183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:35.750537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:35.760948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b06c0417-2fc9-4e7e-99fb-41fcf5f7eaaa tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.107265 Sep 01 08:31:35.761587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1932/3893] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:35 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:35.788929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:35.796901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-163f3a0d-3344-4670-af68-c24ef02f9240 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085990 Sep 01 08:31:35.797457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1962/3894] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:35 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:36.782808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:36.783485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:36.789619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:36.790103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:36.790570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:36.791262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:36.791710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:36.792129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:36.819196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:36.819789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:36.825714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:36.826196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:36.826678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:36.827393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:36.827850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:36.828273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:36.852473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:36.860172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b2ff295f-b98b-4458-8ca9-ea07a15b5dd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081160 Sep 01 08:31:36.860742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1933/3895] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:36 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:36.892279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:36.900135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c1d0443f-6714-47d9-b0bb-6590f953e2e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085414 Sep 01 08:31:36.900702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1963/3896] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:36 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:37.881451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:37.882093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:37.888389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:37.888863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:37.889287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:37.889973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:37.890455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:37.890870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:37.921376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:37.922592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:37.929399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:37.929872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:37.930389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:37.931073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:37.931519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:37.931954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:37.954037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:37.962043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f28419cf-3321-44ec-8cf0-c99c0f8360ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084819 Sep 01 08:31:37.962665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1934/3897] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:37 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:37.993772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:38.001442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f89534b5-0aa5-4d9a-a14c-f1c60af363be tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084261 Sep 01 08:31:38.002004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1964/3898] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:37 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:38.982795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:38.983475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:38.990027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:38.990547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:38.990982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:38.991723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:38.992165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:38.992585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:39.024170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:39.024898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:39.031985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:39.032630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:39.033072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:39.033771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:39.034681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:39.034681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:39.055235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:39.062672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ab68130d-bd25-4148-ad67-95379ff25899 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083678 Sep 01 08:31:39.063234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1935/3899] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:38 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:39.103521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:39.112312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a0a8d14-f21d-44be-a0d2-67900946bc63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.094016 Sep 01 08:31:39.114245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1965/3900] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:39 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:40.086094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:40.086762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:40.092839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:40.093316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:40.093746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:40.094489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:40.094927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:40.095339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:40.140568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:40.141268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:40.147954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:40.148507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:40.149012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:40.149791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:40.150333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:40.150782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:40.162645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:40.170199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eeef3c83-b471-4ea3-b854-e44180f22db7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.087995 Sep 01 08:31:40.170864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1936/3901] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:40 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:40.212712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:40.220530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0cb333ff-b55b-4539-b91b-9d07ef4236fb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083848 Sep 01 08:31:40.221108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1966/3902] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:40 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:41.192852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:41.193663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:41.201792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:41.202298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:41.202751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:41.203460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:41.203909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:41.204366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:41.244690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:41.245301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:41.251677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:41.252152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:41.252588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:41.253264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:41.253708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:41.254225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:41.268879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:41.276475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a4ac8096-f877-4c81-ae08-3272f10ab812 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088408 Sep 01 08:31:41.277039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1937/3903] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:41 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:41.314953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:41.323572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2a14c88a-bbbd-417f-a2e2-289fbc17925a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084122 Sep 01 08:31:41.324145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1967/3904] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:41 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:42.297846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:42.298565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:42.305548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:42.306035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:42.306507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:42.307211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:42.307660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:42.308097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:42.343540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:42.344252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:42.351066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:42.351553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:42.351988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:42.352695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:42.353151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:42.353819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:42.373663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:42.381323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a74239bd-0932-4a6e-8569-b751aa78e0dc tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.087328 Sep 01 08:31:42.381890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1938/3905] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:42 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:42.431722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:42.439931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b96a291-8da1-4be3-b14a-e34f058e873e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.100034 Sep 01 08:31:42.440506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1968/3906] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:42 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:43.402156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:43.402867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:43.409440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:43.409919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:43.410375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:43.411855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:43.412303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:43.412715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:43.461379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:43.461974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:43.467960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:43.468436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:43.468862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:43.469551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:43.470038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:43.470433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:43.475116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:43.482790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e1a6d770-725e-4f65-961f-b89ec022db6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084478 Sep 01 08:31:43.483550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1939/3907] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:43 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:43.531761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:43.540065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a3e0c4e9-cf70-440b-a4a3-d1808549b1c0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083059 Sep 01 08:31:43.540641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1969/3908] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:43 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:44.504292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:44.505615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:44.511173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:44.511672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:44.512097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:44.512772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:44.513211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:44.513627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:44.572536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:44.573148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:44.577146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:44.584646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:44.585131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:44.585581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:44.586289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:44.586824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:44.586937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-30549573-cf0f-4a0f-9dfd-6acbcdc28929 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086576 Sep 01 08:31:44.587245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:44.587455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1940/3909] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:44 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:44.648887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:44.656501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-856a69bf-2662-4bdd-a205-ede0ed9e0271 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087878 Sep 01 08:31:44.657069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1970/3910] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:44 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:45.608140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:45.608821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:45.616170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:45.616656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:45.617099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:45.617875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:45.618248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:45.618838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:45.678848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:45.679783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:45.680482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:45.686480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:45.686654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c62fdeea-eb97-4296-ada3-97ced7d3e26e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082496 Sep 01 08:31:45.687351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:45.687481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1941/3911] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:45 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:45.687667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:45.688421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:45.688940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:45.689446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:45.755558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:45.763140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0f4d5d2e-9697-4950-a500-3ec70392a402 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087816 Sep 01 08:31:45.763712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1971/3912] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:45 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:46.708225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:46.708960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:46.715156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:46.715638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:46.716068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:46.716757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:46.717203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:46.717624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:46.781072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:46.784396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:46.785026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:46.789872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b136cede-c2b2-4de1-87c7-3edb8d44987a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086215 Sep 01 08:31:46.790652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1942/3913] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:46 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:46.792406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:46.792885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:46.793317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:46.794005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:46.794490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:46.794912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:47.000253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:47.008691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75fa1c37-c4df-408c-920d-eb657401ec97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.227999 Sep 01 08:31:47.009243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1972/3914] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:46 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:47.810747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:47.811386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:47.818057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:47.818563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:47.819078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:47.819788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:47.820238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:47.820659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:47.882096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:47.889823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-944e7db1-e6b5-4088-abee-92678aa1f200 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083135 Sep 01 08:31:47.890404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1943/3915] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:47 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:48.030506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:48.031128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:48.037728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:48.038214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:48.038710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:48.039400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:48.039850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:48.040273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:48.106925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:48.115269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2926ddf7-8ae2-4f49-b697-8942d2d44a3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088558 Sep 01 08:31:48.115844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1973/3916] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:48 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:48.912037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:48.912704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:48.918826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:48.919310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:48.919744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:48.920437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:48.920887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:48.921303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:48.981746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:48.990030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a57c80c5-e348-4462-970b-b76f4af57a45 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082231 Sep 01 08:31:48.990619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1944/3917] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:48 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:49.136803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:49.137409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:49.143429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:49.143905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:49.144333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:49.145632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:49.146072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:49.146515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:49.150689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:49.212273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:49.219906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d3900e7b-16a3-454e-9f45-60045e6b41e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087175 Sep 01 08:31:49.220466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1974/3918] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:49 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:50.010653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:50.011370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:50.017491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:50.017965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:50.018427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:50.019105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:50.019551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:50.020029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:50.024054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:50.089379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:50.097167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-721f98dc-e398-4264-92af-68c3ca931d1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090357 Sep 01 08:31:50.097733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1945/3919] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:50 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:50.241689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:50.242343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:50.248519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:50.249000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:50.249553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:50.250507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:50.250957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:50.251605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:50.313822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:50.321945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-854ed7ff-85fa-4c7b-a6c7-7827a7be8c8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084804 Sep 01 08:31:50.322536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1975/3920] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:50 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:51.119058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:51.119719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:51.125877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:51.126392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:51.126831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:51.127520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:51.127970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:51.128393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:51.189061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:51.197097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1a8e37f-2dd9-4834-ba6e-fec6f0f23cae tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082077 Sep 01 08:31:51.197680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1946/3921] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:51 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:51.342926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:51.343540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:51.349747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:51.350228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:51.350674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:51.351473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:51.351989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:51.352495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:51.419089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:51.427234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7904a7fb-8553-4bff-9f8a-ac788b2eddf6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088396 Sep 01 08:31:51.427787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1976/3922] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:51 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:52.218897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:52.219535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:52.225461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:52.225928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:52.226382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:52.227052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:52.227495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:52.228079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:52.287922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:52.295466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7fd25336-2463-49de-9480-a94e6b3bbd77 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080365 Sep 01 08:31:52.296015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1947/3923] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:52 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:52.448898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:52.449489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:52.455762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:52.456240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:52.456671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:52.457395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:52.457865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:52.458304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:52.519672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:52.527978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-167567fc-599b-4cf6-9cc9-041f4673e937 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082939 Sep 01 08:31:52.528627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1977/3924] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:52 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:53.317339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:53.318126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:53.324336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:53.324810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:53.325241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:53.325922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:53.326483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:53.326903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:53.387240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:53.394584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9b8e2598-902f-4da3-8d90-4f8268293c64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081738 Sep 01 08:31:53.395700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1948/3925] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:53 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:53.548172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:53.548782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:53.554848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:53.555330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:53.555764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:53.556452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:53.556902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:53.557323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:53.621619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:53.629580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-403dd0ca-d768-4158-8f27-e484629c399b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085200 Sep 01 08:31:53.630280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1978/3926] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:53 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:54.416043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:54.416657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:54.422669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:54.423145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:54.423576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:54.424292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:54.424734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:54.425153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:54.489430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:54.503994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9bafeccf-962f-4730-beda-b91cd5ac4b1c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.091936 Sep 01 08:31:54.505177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1949/3927] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:54 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:54.650533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:54.651141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:54.657220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:54.657601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:54.658031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:54.658737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:54.659186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:54.659625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:54.719742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:54.728200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28341b9e-45df-42a7-87cb-9cc967c4cd5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081580 Sep 01 08:31:54.728768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1979/3928] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:54 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:31:55.526739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:55.527351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:55.533244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:55.533718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:55.534152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:55.534856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:55.535304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:55.535724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:55.601622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:55.609364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-75dfa965-9669-4121-a0d3-15c1f6ff8a35 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086448 Sep 01 08:31:55.609934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1950/3929] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:55 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:55.749483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:55.750048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:55.756613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:55.757088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:55.757515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:55.758193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:55.758665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:55.759086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:55.826582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:55.835823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b444c363-5734-49a8-858c-541a3a12cf80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090000 Sep 01 08:31:55.836469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1980/3930] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:55 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:56.633779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:56.634443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:56.640425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:56.640907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:56.641337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:56.642017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:56.642504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:56.642924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:56.702923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:56.711222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c66e18ae-1c54-4af0-bd02-d4d5153036db tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081936 Sep 01 08:31:56.711779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1951/3931] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:56 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:56.859819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:56.860414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:56.866417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:56.866899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:56.867332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:56.868019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:56.868504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:56.868891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:56.930671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:56.942188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7ced5a5a-6fbd-49e4-9a6a-47b0c858a3f3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086266 Sep 01 08:31:56.943521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1981/3932] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:56 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:57.731077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:57.731665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:57.737711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:57.738189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:57.738653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:57.739852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:57.740299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:57.740725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:57.803957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:57.811537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1d5e96da-562d-4419-a64f-f9d1cef8d915 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084382 Sep 01 08:31:57.812100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1952/3933] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:57 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:57.964350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:57.964988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:57.970875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:57.971346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:57.971777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:57.972446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:57.972890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:57.973312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:58.037284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:58.045149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ebde4151-8e53-4037-b0f3-fc06c29d4e24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084525 Sep 01 08:31:58.045737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1982/3934] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:57 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:58.833697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:58.834933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:58.841032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:58.841507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:58.841935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:58.842644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:58.843087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:58.843498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:58.903388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:58.911304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-debf12e8-cb17-4677-9d8d-7aa82f7b759a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082329 Sep 01 08:31:58.911874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1953/3935] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:58 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:59.066764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:59.068137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:59.074111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:59.074622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:59.075058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:59.075742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:59.076192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:59.076619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:59.136551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:31:59.144444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0bf906b-e474-4a57-b01f-2594aa79e11d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081489 Sep 01 08:31:59.145013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1983/3936] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:59 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:31:59.932296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:31:59.932920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:31:59.938942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:59.939424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:59.939856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:31:59.940543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:31:59.940992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:31:59.941412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:00.000949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:00.008613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f8c061e-5bf4-45e2-9f7b-5e7498f34231 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080516 Sep 01 08:32:00.009176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1954/3937] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:31:59 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:00.165505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:00.166114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:00.172033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:00.172508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:00.172938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:00.173616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:00.174058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:00.174532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:00.236375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:00.244292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d6b2731-e973-4677-800c-256386e3c149 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083190 Sep 01 08:32:00.244871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1984/3938] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:00 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:01.029673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:01.030321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:01.036880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:01.037350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:01.037774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:01.038492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:01.038938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:01.039351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:01.100282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:01.107884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4af73d4-df51-4ceb-8e7b-a52529c39944 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082036 Sep 01 08:32:01.108446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1955/3939] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:01 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:01.265199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:01.265807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:01.271747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:01.272224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:01.272651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:01.273332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:01.273778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:01.274192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:01.335400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:01.342947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-08dfa02d-202a-4479-b3be-2f5a6eff8553 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081545 Sep 01 08:32:01.343512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1985/3940] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:01 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:02.133522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:02.134202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:02.140192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:02.140676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:02.141108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:02.141804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:02.142253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:02.142697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:02.203820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:02.211593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e195f351-ae87-4246-ba57-e48f240f4b17 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083004 Sep 01 08:32:02.212145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1956/3941] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:02 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:02.365661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:02.366280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:02.372191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:02.372672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:02.373088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:02.373754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:02.374197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:02.374636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:02.436278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:02.448818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a3d7c28-9201-47a1-978f-612e353ff96a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087054 Sep 01 08:32:02.449851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1986/3942] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:02 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:03.232013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:03.232621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:03.238648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:03.239136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:03.239571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:03.240258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:03.240707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:03.241127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:03.299634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:03.307703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e49c634d-2b1e-471d-a960-5571431a0cdb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079554 Sep 01 08:32:03.308270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1957/3943] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:03 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:03.471322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:03.471828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:03.473603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=56 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:03.478996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:03.479475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:03.479904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:03.480583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:03.481029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:03.481446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:03.541224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:03.548876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a8b27392-ec48-40e5-bf9a-c2d2eb7e7f58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081464 Sep 01 08:32:03.549452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1987/3944] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:03 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:04.329030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:04.329635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:04.336196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:04.336678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:04.337105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:04.337825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:04.338281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:04.338704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:04.397901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:04.405407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-628f59e5-6098-44bf-b18e-765f021e633b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080292 Sep 01 08:32:04.406044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1958/3945] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:04 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:04.571100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:04.571699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:04.577661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:04.578137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:04.578601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:04.579371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:04.579821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:04.580539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:04.643552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:04.651303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd2fccdd-3456-4a09-bd8f-95c79c5e7908 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084086 Sep 01 08:32:04.651875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1988/3946] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:04 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:05.426365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:05.427045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:05.433228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:05.433715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:05.434144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:05.434859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:05.435308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:05.435723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:05.498523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:05.506671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1b4b242-321f-4b73-8bcd-b786ce4e4b78 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084085 Sep 01 08:32:05.507232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1959/3947] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:05 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:05.673972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:05.675284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:05.681963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:05.682414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:05.682846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:05.683522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:05.683966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:05.684381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:05.747676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:05.756066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5d676060-931c-4391-aa57-ddf35ed1fe16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085853 Sep 01 08:32:05.756639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1989/3948] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:05 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:06.527474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:06.528106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:06.529945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=56 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:06.536709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:06.537198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:06.537628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:06.538333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:06.538778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:06.539198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:06.602421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:06.610061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-52cd180c-57d6-471a-a143-0c3f782a5dfb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086435 Sep 01 08:32:06.610649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1960/3949] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:06 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:06.775960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:06.776513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:06.782421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:06.782923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:06.783353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:06.784031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:06.784474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:06.784889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:06.847877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:06.852004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:06.857866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f81dd1d2-d6a2-4748-9711-c8f3ff895d87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085428 Sep 01 08:32:06.858479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1990/3950] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:06 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:07.632690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:07.633365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:07.649086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:07.649086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:07.649086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:07.649086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:07.650058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:07.650058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:07.714974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:07.718354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:07.723973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7c414164-998c-438d-b327-9152c6354ee6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.095134 Sep 01 08:32:07.724533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1961/3951] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:07 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:07.879225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:07.879840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:07.886071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:07.886587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:07.887014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:07.887685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:07.888131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:07.888544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:07.950153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:07.958757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8098468e-0e6a-4140-b194-747c2fd3ed96 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083515 Sep 01 08:32:07.959443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1991/3952] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:07 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:08.745749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:08.746338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:08.752476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:08.752958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:08.753394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:08.754095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:08.755216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:08.755646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:08.815316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:08.823490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1116cb9b-d7c1-430e-82bf-e32788c97505 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081933 Sep 01 08:32:08.824040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1962/3953] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:08 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:08.981121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:08.982197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:08.988827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:08.989833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:08.990276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:08.990968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:08.991411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:08.991831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:09.054235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:09.062096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-69571aca-8760-4700-bbb2-980b3d23e75f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086284 Sep 01 08:32:09.063115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1992/3954] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:08 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:09.844363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:09.845065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:09.852188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:09.852672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:09.853102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:09.853789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:09.854236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:09.854680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:09.915893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:09.923597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a37b95fc-1aba-455d-80ad-2236b93211b6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083095 Sep 01 08:32:09.924157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1963/3955] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:09 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:10.143631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:10.144322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:10.150432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:10.150957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:10.151451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:10.152195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:10.152678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:10.153143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:10.215265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:10.223020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1dec2004-ea68-4c79-95e9-ddbae442150a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083259 Sep 01 08:32:10.224311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1993/3956] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:10 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:32:10.944588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:10.945212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:10.951175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:10.951654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:10.952088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:10.952768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:10.953213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:10.953633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:11.015346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:11.022847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ead1f4f-d801-4ac7-907c-b41b4a70e622 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082707 Sep 01 08:32:11.023429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1964/3957] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:10 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:11.244843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:11.245431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:11.251156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:11.251627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:11.252049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:11.252715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:11.253153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:11.253571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:11.320011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:11.327665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-74392192-82eb-4b4b-84da-4b43fd1c4732 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086711 Sep 01 08:32:11.328215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1994/3958] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:11 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:12.045500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:12.046114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:12.053357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:12.053846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:12.054303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:12.055010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:12.055462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:12.055886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:12.120836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:12.128875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4af1678-2577-46d0-9730-3ebd8d23c3c0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088571 Sep 01 08:32:12.129667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1965/3959] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:12 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:12.349000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:12.349557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:12.356210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:12.356696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:12.357124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:12.357802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:12.358247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:12.358683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:12.420544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:12.428659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2421d3dc-0596-4bd3-b741-240af49ffdae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083134 Sep 01 08:32:12.429248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1995/3960] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:12 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:13.154463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:13.155161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:13.161078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:13.161544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:13.161973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:13.162712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:13.163158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:13.163676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:13.224642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:13.233013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d9f47d21-737c-4c5f-bdad-69927de68162 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082490 Sep 01 08:32:13.233569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1966/3961] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:13 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:13.449273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:13.449830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:13.455931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:13.456397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:13.456821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:13.457492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:13.457934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:13.458378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:13.525185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:13.532933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a7ee83d-a1c2-49d3-af7e-aab638fc3c56 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087563 Sep 01 08:32:13.533513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1996/3962] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:13 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:14.253208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:14.253831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:14.260430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:14.260914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:14.261379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:14.262047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:14.262534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:14.262958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:14.324450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:14.332145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-22a56126-9c3b-4929-afd3-4d66d0b9ed41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082931 Sep 01 08:32:14.332708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1967/3963] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:14 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:14.553718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:14.554338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:14.560309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:14.560781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:14.561202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:14.561880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:14.562348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:14.562770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:14.626090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:14.634800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30c2b880-77bb-4072-89cb-a37a8a438dfa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084792 Sep 01 08:32:14.635386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1997/3964] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:14 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:15.353643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:15.354278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:15.360230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:15.360707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:15.361133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:15.361817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:15.362276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:15.362702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:15.425504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:15.433158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-da5aa46b-ca8c-4a7f-a0d5-d7d78c29aa4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085006 Sep 01 08:32:15.433708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1968/3965] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:15 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:15.654794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:15.655363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:15.668236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:15.668718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:15.669142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:15.669830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:15.670293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:15.670709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:15.735553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:15.744070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d670ea13-941b-49e8-bbc7-1196fce187b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.093037 Sep 01 08:32:15.744644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1998/3966] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:15 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:16.452980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:16.453723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:16.460151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:16.460633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:16.461061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:16.461779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:16.462226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:16.462683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:16.526641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:16.534227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ea511ca-319f-4a69-8e66-53ece878e5c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085073 Sep 01 08:32:16.534821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1969/3967] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:16 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:16.765212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:16.765785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:16.772249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:16.772740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:16.773165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:16.773885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:16.774362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:16.774785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:16.837345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:16.845248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-deed4bb9-a114-49f1-99ee-b2ef783ee6a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083898 Sep 01 08:32:16.845834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 1999/3968] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:16 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:17.558187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:17.558812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:17.564823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:17.565318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:17.565752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:17.566480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:17.566928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:17.567352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:17.629015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:17.636702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-39a12663-a007-4410-bade-5cb9e3868d55 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083870 Sep 01 08:32:17.637877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1970/3969] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:17 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:17.866432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:17.867029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:17.873103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:17.873570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:17.874002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:17.874772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:17.875212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:17.875624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:17.940861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:17.948876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c748329a-0e3c-4029-8e42-2887744de6c7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086764 Sep 01 08:32:17.949448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2000/3970] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:17 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:18.657740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:18.658346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:18.665133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:18.665611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:18.666036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:18.666747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:18.667198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:18.667615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:18.729948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:18.738027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-adbf564b-9a31-48fb-b36a-c8c58ba98c02 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084106 Sep 01 08:32:18.738618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1971/3971] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:18 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:18.969141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:18.969758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:18.975858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:18.976334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:18.976762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:18.977515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:18.977904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:18.978341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:19.045136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:19.054560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-df5fa7b1-c141-4024-83bb-162daae5d746 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.089077 Sep 01 08:32:19.055146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2001/3972] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:18 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:19.760460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:19.761037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:19.766966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:19.767441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:19.767867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:19.768576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:19.769016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:19.769429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:19.830642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:19.838760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-543091d5-4643-4726-902c-42ce178ce452 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082292 Sep 01 08:32:19.839207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1972/3973] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:19 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:20.075613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:20.076244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:20.082494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:20.082966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:20.083412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:20.084611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:20.085062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:20.085474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:20.151911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:20.161162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3209c88-9adf-4a9c-97e8-acb36a1cb55b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.089236 Sep 01 08:32:20.161855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2002/3974] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:20 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:20.860009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:20.860640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:20.867507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:20.867983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:20.868426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:20.869096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:20.869539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:20.869954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:20.931942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:20.939819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d0924e5-d519-4aa6-892a-e802a823c098 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083337 Sep 01 08:32:20.940586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1973/3975] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:20 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:21.181753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:21.182377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:21.188964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:21.189849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:21.189849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:21.190870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:21.191468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:21.192015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:21.257044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:21.265137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0eb74ab1-0c7b-47d9-bad3-1024976d1945 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087458 Sep 01 08:32:21.265721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2003/3976] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:21 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:21.962362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:21.963015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:21.969030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:21.969503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:21.969942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:21.970659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:21.971109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:21.971527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:22.031539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:22.039176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ac8ed9f-fad9-4f29-bb3d-b4ec83f91fc0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081618 Sep 01 08:32:22.039753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1974/3977] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:21 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:22.287339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:22.287933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:22.294648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:22.295123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:22.295548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:22.296228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:22.296667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:22.297078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:22.361207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:22.369195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e3a6eec4-f0bb-47c6-98d3-c513316355fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085607 Sep 01 08:32:22.369760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2004/3978] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:22 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:23.060441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:23.061059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:23.067209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:23.067693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:23.068132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:23.068825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:23.069275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:23.069781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:23.133646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:23.141529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1ba08a42-833d-4ef4-859b-c759a362b619 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085001 Sep 01 08:32:23.142126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1975/3979] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:23 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:23.389946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:23.390551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:23.396638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:23.397112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:23.397541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:23.398909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:23.399369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:23.399786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:23.463704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:23.474311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8254525f-f7b8-49f4-b6c7-0e7b095f33f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087257 Sep 01 08:32:23.474311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2005/3980] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:23 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:24.163013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:24.163690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:24.169938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:24.170457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:24.170893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:24.171584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:24.172032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:24.172451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:24.235467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:24.243591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-63ce7dad-d607-4b89-98fc-56df0cf4fb7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084624 Sep 01 08:32:24.244146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1976/3981] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:24 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:24.495577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:24.496259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:24.503294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:24.504019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:24.504324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:24.505022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:24.505573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:24.507044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:24.569896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:24.578130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-53bb7b1c-0fc4-46e9-9a0c-ecf30929fa94 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086496 Sep 01 08:32:24.578760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2006/3982] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:24 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:25.264464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:25.265097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:25.271075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:25.271549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:25.271975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:25.272715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:25.273159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:25.273574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:25.334388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:25.342884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6fc81143-262a-4d70-8f9f-a38813daa92c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082358 Sep 01 08:32:25.343477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1977/3983] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:25 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:25.599787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:25.600440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:25.606636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:25.607113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:25.607543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:25.608222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:25.608675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:25.609089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:25.628038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:25.673841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:25.682977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-92025ce6-a45f-48a3-a598-1e5727d4fcc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086325 Sep 01 08:32:25.683782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2007/3984] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:25 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:26.364673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:26.365276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:26.371491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:26.371958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:26.372400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:26.373060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:26.373499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:26.373953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:26.393202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:26.439464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:26.447129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-34e49deb-6a55-4cf3-adff-473d0cea2d9f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086394 Sep 01 08:32:26.447678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1978/3985] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:26 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:26.704105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:26.704945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:26.711740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:26.712222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:26.712676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:26.713403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:26.713851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:26.714289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:26.779673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:26.787524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9f5decd-5bdd-4606-bc80-e5d5b5a12dd3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087454 Sep 01 08:32:26.789000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2008/3986] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:26 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:27.468506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:27.469066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:27.475317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:27.475872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:27.476382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:27.477091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:27.477533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:27.477949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:27.547329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:27.555070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eea883ad-a0ec-4b3f-b289-1f687fdbf54a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090574 Sep 01 08:32:27.555637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1979/3987] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:27 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:27.808651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:27.809258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:27.815312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:27.815791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:27.816221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:27.816939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:27.817361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:27.817778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:27.880641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:27.890581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-965cd29f-a23b-4bae-8391-4b5bdf1252ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085836 Sep 01 08:32:27.891170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2009/3988] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:27 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:32:28.575981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:28.576571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:28.583195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:28.583683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:28.584120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:28.584821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:28.585454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:28.586190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:28.650760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:28.658382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-99d55003-fa4c-439a-a1c1-c950495b5909 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086245 Sep 01 08:32:28.658940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1980/3989] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:28 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:28.913194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:28.914614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:28.920539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:28.921014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:28.921441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:28.922120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:28.922588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:28.923005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:28.986864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:28.994908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf8bad59-0657-4f3b-abf3-8941362316fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085744 Sep 01 08:32:28.995479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2010/3990] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:28 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:29.679734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:29.680340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:29.686466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:29.686948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:29.687379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:29.688071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:29.688517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:29.688938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:29.750966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:29.758449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a090b200-8dc9-489b-94ae-2d4d6b0333b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082609 Sep 01 08:32:29.758996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1981/3991] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:29 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:30.281460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:30.282070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:30.288051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:30.288531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:30.288963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:30.289637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:30.290085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:30.290543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:30.349831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:30.357469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f4372cdf-a549-49a1-97af-43d9138217c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.345375 Sep 01 08:32:30.358033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2011/3992] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:30 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:30.779790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:30.780394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:30.786709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:30.787205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:30.787636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:30.788330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:30.788901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:30.789208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:30.854518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:30.862153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f0aa2125-7c5c-428f-b075-c8f5325dab94 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086353 Sep 01 08:32:30.862743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1982/3993] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:30 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:31.378689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:31.379287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:31.387344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:31.387814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:31.388240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:31.388920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:31.389360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:31.389772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:31.452147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:31.459994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5c936da-ffb7-4085-9310-05f8c00eb718 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085122 Sep 01 08:32:31.461126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2012/3994] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:31 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:31.883060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:31.883776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:31.889801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:31.890337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:31.890771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:31.891460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:31.891907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:31.892326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:31.958952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:31.967570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fa422d98-5524-4fb7-b0c0-413141b84abe tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089079 Sep 01 08:32:31.969975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1983/3995] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:31 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:32.482582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:32.483233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:32.489689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:32.490200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:32.490671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:32.491449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:32.491882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:32.492373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:32.573887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:32.582932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf7f86fc-e76a-4eb0-8e42-a7191fa7f547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.104945 Sep 01 08:32:32.583680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2013/3996] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:32 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:32.991956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:32.992837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:32.998804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:32.999287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:32.999719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:33.000408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:33.000858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:33.001275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:33.063343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:33.071330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e071d02-af2a-48c2-9405-354423a941b3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083844 Sep 01 08:32:33.071887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1984/3997] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:32 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:33.605416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:33.606020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:33.607977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=54 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:33.613197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:33.613660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:33.614089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:33.614792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:33.615233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:33.615651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:33.677464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:33.684985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-295a4ed1-af81-454d-b329-99280510464c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083448 Sep 01 08:32:33.685540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2014/3998] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:33 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:34.092208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:34.092813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:34.098753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:34.099232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:34.099668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:34.100348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:34.101408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:34.101829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:34.162809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:34.170905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-08f73b75-b6a0-4ead-a3be-4b635a2f799e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082534 Sep 01 08:32:34.171462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1985/3999] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:34 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:34.706007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:34.706639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:34.713099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:34.713580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:34.714006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:34.714716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:34.715163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:34.715583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:34.775763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:34.783356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe687d50-fd41-45f2-9e65-f381bb71e356 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081464 Sep 01 08:32:34.783909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2015/4000] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:34 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:35.194880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:35.195495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:35.201495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:35.201976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:35.202448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:35.203135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:35.203584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:35.204005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:35.265477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:35.273246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70854995-c51e-4436-963f-935cc2651052 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082165 Sep 01 08:32:35.273800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1986/4001] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:35 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:35.804442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:35.805041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:35.810992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:35.811462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:35.811885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:35.812559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:35.813021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:35.813467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:35.875688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:35.883925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-885c98a4-333a-4a31-9b80-a3f2c229081e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083335 Sep 01 08:32:35.884574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2016/4002] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:35 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:32:36.293677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:36.294296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:36.300282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:36.300760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:36.301194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:36.301875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:36.302356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:36.302777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:36.364095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:36.372276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-943b68ee-b832-49f2-a472-52f2daf6f60f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082455 Sep 01 08:32:36.372832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1987/4003] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:36 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:36.903775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:36.904363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:36.910341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:36.910850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:36.911283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:36.911964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:36.912415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:36.912929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:36.973293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:36.982037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5f8b0d15-aea8-49cf-b0d3-9c441393c9a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082054 Sep 01 08:32:36.982642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2017/4004] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:36 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:37.392789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:37.393395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:37.395269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=56 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:37.401251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:37.401733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:37.402163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:37.402880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:37.403327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:37.403765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:37.465687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:37.473605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1879e8e3-e9c1-4d47-b4cb-7b60a985483a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084576 Sep 01 08:32:37.474178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1988/4005] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:37 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:38.002592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:38.003203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:38.009259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:38.009735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:38.010167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:38.010875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:38.011331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:38.011753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:38.074227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:38.082029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65b2f25e-b709-4dbf-9df9-21771719150f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083282 Sep 01 08:32:38.082622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2018/4006] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:37 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:38.495428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:38.496022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:38.501986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:38.502497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:38.502922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:38.503596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:38.504039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:38.504454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:38.571765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:38.579482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a1caede7-baa7-4905-afd5-21e15de78466 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088351 Sep 01 08:32:38.580329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1989/4007] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:38 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:39.102627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:39.103291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:39.109124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:39.109602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:39.110036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:39.110743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:39.111192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:39.111612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:39.171060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:39.178505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1c184cda-eb63-48a6-ada0-2929aa73aaf5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080184 Sep 01 08:32:39.179797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2019/4008] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:39 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:39.601894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:39.602558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:39.608577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:39.609051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:39.609479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:39.610157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:39.610639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:39.611051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:39.671844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:39.679544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f4dd3eb7-ad27-4022-98f4-d103ca4b1e4c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081490 Sep 01 08:32:39.680095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1990/4009] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:39 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:40.201574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:40.202182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:40.208453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:40.208932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:40.209364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:40.210239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:40.210719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:40.211146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:40.275932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:40.283606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-54369ffd-f3ec-4946-b685-29bec8c3b178 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085823 Sep 01 08:32:40.284160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2020/4010] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:40 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:40.699151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:40.699802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:40.706124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:40.706633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:40.707065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:40.707748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:40.708195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:40.708613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:40.776008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:40.783940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6363a458-a59f-4a8b-9690-75437697fe68 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088613 Sep 01 08:32:40.784509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1991/4011] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:40 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:41.304900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:41.305515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:41.311422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:41.311897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:41.312324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:41.313007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:41.313453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:41.313871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:41.374208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:41.381739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fe3bdc2b-17bf-497e-b121-b81368b05238 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081403 Sep 01 08:32:41.382601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2021/4012] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:41 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:32:41.807124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:41.808381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:41.819894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:41.820725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:41.821457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:41.822753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:41.823529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:41.824224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:41.886361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:41.893971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3c27bf31-3120-4b19-a688-947562fc967a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.092375 Sep 01 08:32:41.894570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1992/4013] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:41 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:42.402486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:42.403095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:42.408940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:42.409410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:42.409852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:42.410524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:42.410966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:42.411377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:42.472730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:42.480614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c56051c-7c91-4fab-98cb-12ac55267599 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081990 Sep 01 08:32:42.481171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2022/4014] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:42 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:42.915308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:42.915977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:42.921950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:42.922535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:42.922971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:42.923661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:42.924107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:42.924525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:42.987754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:42.996034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7d05348c-69fe-419d-ab50-037902f5d631 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085007 Sep 01 08:32:42.996616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1993/4015] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:42 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:43.501589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:43.502191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:43.508809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:43.509294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:43.509727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:43.510469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:43.510918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:43.511339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:43.570852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:43.578562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-42aa4e4e-7e16-47b6-98bd-90421393a3cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080701 Sep 01 08:32:43.579140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2023/4016] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:43 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:44.016356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:44.016969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:44.023091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:44.023573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:44.024007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:44.024690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:44.025141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:44.025564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:44.084487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:44.092352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5a7b1824-74b1-406f-9a99-f6b0b9f2a629 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079762 Sep 01 08:32:44.092919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1994/4017] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:44 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:44.604505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:44.605177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:44.611138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:44.611613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:44.612037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:44.612709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:44.613151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:44.613567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:44.617507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:44.676519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:44.684147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd9d3f23-5fcb-49d7-b5ad-e7847f742c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084047 Sep 01 08:32:44.684703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2024/4018] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:44 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:45.112744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:45.113358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:45.119571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:45.120065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:45.120501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:45.121185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:45.121666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:45.122088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:45.126102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:45.183383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:45.190928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-486454bd-f070-47f7-9a8b-0e70bcf69e25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082085 Sep 01 08:32:45.191488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1995/4019] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:45 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:45.704830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:45.705443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:45.712043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:45.712522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:45.712953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:45.713632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:45.714081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:45.714538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:45.774873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:45.782340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d459b22-f843-4bc9-8817-bc7eeee1e2b7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081622 Sep 01 08:32:45.782900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2025/4020] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:45 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:46.212156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:46.212749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:46.218653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:46.219135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:46.219563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:46.220232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:46.220669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:46.221080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:46.280220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:46.287600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd7b4818-4f8e-4388-91b5-3fa2b515ec81 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079323 Sep 01 08:32:46.288211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1996/4021] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:46 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:46.803057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:46.803738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:46.809741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:46.810216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:46.810677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:46.811353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:46.811795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:46.812211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:46.874057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:46.881635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-005d6308-34ef-480e-abf0-4ddfcd3c7b70 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082424 Sep 01 08:32:46.882188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2026/4022] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:46 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:32:47.308197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:47.308879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:47.314815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:47.315313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:47.315756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:47.316427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:47.316874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:47.317296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:47.378955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:47.387202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-addcdd7e-22f0-482d-8b17-dedb25ad9b58 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082996 Sep 01 08:32:47.387759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1997/4023] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:47 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:47.901021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:47.901649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:47.907618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:47.908097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:47.908525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:47.909206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:47.909650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:47.910070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:47.969431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:47.977611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-94f9562f-eb1c-4cb3-a7a4-0fc3a3c68c84 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080486 Sep 01 08:32:47.978175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2027/4024] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:47 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:48.408431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:48.409037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:48.415732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:48.416210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:48.416641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:48.417324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:48.417768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:48.418188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:48.477600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:48.485105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2eb11d6d-9a26-4421-b855-20134be10bd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080699 Sep 01 08:32:48.485663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1998/4025] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:48 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:48.998098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:48.998740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:49.004603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:49.005077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:49.005506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:49.006180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:49.007410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:49.007852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:49.068487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:49.076662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7b72856-2b4b-4a00-bcda-c5f9c1dd7aa6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082419 Sep 01 08:32:49.077219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2028/4026] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:48 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:49.504824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:49.505425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:49.511424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:49.511896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:49.512323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:49.512991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:49.513432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:49.513844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:49.572028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:49.580028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d35b75b-1ac4-4dea-8f81-7cde89879b8b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.078745 Sep 01 08:32:49.580590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 1999/4027] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:49 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:50.097404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:50.098030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:50.104171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:50.104557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:50.104987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:50.105675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:50.106119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:50.106557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:50.167603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:50.175095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f8b1c297-c2d5-43a7-8610-3ee1f59c8542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081634 Sep 01 08:32:50.175652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2029/4028] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:50 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:50.602100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:50.603066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:50.610796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:50.611505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:50.611951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:50.612638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:50.613081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:50.613494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:50.678097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:50.687818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc135dd2-118d-4e6b-9f95-f24962648d11 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089092 Sep 01 08:32:50.688426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2000/4029] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:50 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:51.195973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:51.196592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:51.202523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:51.202991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:51.203415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:51.204089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:51.204789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:51.205202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:51.267659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:51.275736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6ee6537d-f4f0-452e-9880-50bf5cb132c3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083575 Sep 01 08:32:51.276307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2030/4030] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:51 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:51.709863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:51.710538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:51.717067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:51.717535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:51.717962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:51.718662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:51.719105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:51.719523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:51.778971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:51.786556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb3e734b-391d-4d12-9084-dc3b2a192337 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080558 Sep 01 08:32:51.787114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2001/4031] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:51 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:52.296520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:52.297122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:52.303084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:52.303558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:52.303985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:52.304658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:52.305811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:52.306362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:52.365859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:52.373996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1005a9a6-d49d-410a-9439-2fd54bb40c18 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081316 Sep 01 08:32:52.374588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2031/4032] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:52 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:52.808280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:52.808896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:52.816545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:52.817028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:52.817480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:52.818270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:52.818749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:52.819175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:52.879016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:52.887262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47f4673a-0053-4d5d-ac7b-7b513a9c2ab5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083908 Sep 01 08:32:52.887751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2002/4033] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:52 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:53.394727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:53.395333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:53.401376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:53.401903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:53.402370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:53.403055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:53.403501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:53.403925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:53.467264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:53.475385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c85d7ff-fe34-4a5a-8098-5aac9674df49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084408 Sep 01 08:32:53.475957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2032/4034] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:53 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:53.908225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:53.908851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:53.910794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:32:53.910938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 (ip 10.222.0.43) !!! Sep 01 08:32:53.918115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:53.918621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:53.919053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:53.919738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:53.920185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:53.920607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:53.981369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:53.989012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cea5b9e2-ab3c-4627-b16c-c26e7ae40bf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084547 Sep 01 08:32:53.989576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2003/4035] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:53 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:54.496420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:54.497041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:54.502683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:54.503161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:54.503584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:54.504264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:54.504706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:54.505122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:54.565232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:54.573284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-29902365-ca94-4370-b9c7-b09203e54ddc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080851 Sep 01 08:32:54.573908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2033/4036] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:54 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:55.010873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:55.011468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:55.019009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:55.019743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:55.020413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:55.021179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:55.021724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:55.022340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:55.081750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:55.089546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dfecda2c-ff6c-4691-9bc9-6c5d68ec3abb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083148 Sep 01 08:32:55.090228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2004/4037] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:55 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:55.594399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:55.595050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:55.597038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:32:55.597165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:32:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 (ip 10.222.0.43) !!! Sep 01 08:32:55.603339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:55.603811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:55.604242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:55.604916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:55.605365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:55.605777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:55.670093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:55.677780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc127211-05d1-4c42-aab5-4f0a38f432d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087197 Sep 01 08:32:55.678386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2034/4038] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:55 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:56.110892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:56.111470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:56.118183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:56.118743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:56.119175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:56.119863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:56.120312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:56.120737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:56.183038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:56.190514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-42249c33-4659-469b-b766-b143d75491f3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084095 Sep 01 08:32:56.191068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2005/4039] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:56 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:56.699956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:56.700485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:56.706623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:56.707090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:56.707511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:56.708190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:56.708618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:56.709028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:56.769263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:56.777012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a8559a6-7cc6-4c45-8402-aa89c5b6d1f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081533 Sep 01 08:32:56.777566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2035/4040] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:56 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:57.212211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:57.212876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:57.219143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:57.219647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:57.220073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:57.220748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:57.221191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:57.221606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:57.281301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:57.288878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-835177ff-109c-4ff0-806b-0908c9604610 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081129 Sep 01 08:32:57.290081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2006/4041] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:57 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:57.797290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:57.797895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:57.803694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:57.804163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:57.804585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:57.805466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:57.805916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:57.806361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:57.867533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:57.875050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9724c99-f05e-41b8-9e61-c5920236ec91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081564 Sep 01 08:32:57.875604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2036/4042] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:57 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:58.310547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:58.311148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:58.317041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:58.317508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:58.317929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:58.318619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:58.319059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:58.319469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:58.378363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:58.385890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed86793c-cfe9-40f2-a7ce-7a5c0ab25598 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079249 Sep 01 08:32:58.386471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2007/4043] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:58 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:58.896144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:58.896720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:58.903335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:58.903812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:58.904269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:58.904950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:58.905396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:58.905814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:58.966234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:58.973818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7c8c062-99b3-4899-ad7a-11cb1713227c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081562 Sep 01 08:32:58.974405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2037/4044] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:58 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:59.406501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:59.407096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:32:59.412983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:59.413457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:59.413888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:59.414726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:32:59.415251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:32:59.415669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:32:59.474511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:32:59.481959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-81b638fe-43e2-4d4f-b28c-2feba0da95f6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079334 Sep 01 08:32:59.482542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2008/4045] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:59 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:32:59.995380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:32:59.996058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:00.001752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:00.002234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:00.002698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:00.003378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:00.004030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:00.004245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:00.069281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:00.081326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aa26276f-a83d-4756-9188-5fc38108420a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.089859 Sep 01 08:33:00.081887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2038/4046] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:32:59 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:00.503268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:00.503878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:00.510606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:00.511172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:00.511508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:00.512216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:00.512658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:00.513083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:00.572375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:00.580665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3a3a8de-fee9-4c6d-ac5f-a1585f985cd1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081171 Sep 01 08:33:00.581233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2009/4047] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:00 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:01.102632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:01.103329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:01.109267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:01.109745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:01.110176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:01.110886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:01.111333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:01.111752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:01.171277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:01.178940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-06bd19ad-06d1-4568-8dd8-99af9d001c10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080846 Sep 01 08:33:01.179516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2039/4048] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:01 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:01.602631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:01.603311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:01.609265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:01.609745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:01.610180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:01.610891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:01.611341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:01.611767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:01.670927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:01.678471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9d19fc5d-d61c-4c8a-93ed-ec5283f636d3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079761 Sep 01 08:33:01.679031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2010/4049] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:01 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:02.200334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:02.200970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:02.207084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:02.207553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:02.207996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:02.208670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:02.209109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:02.209524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:02.271128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:02.274605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:02.279545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8ad23799-b13d-4b10-b75a-24a3203c75d4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083030 Sep 01 08:33:02.280103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2040/4050] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:02 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:02.699398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:02.700008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:02.706144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:02.706646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:02.707071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:02.707743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:02.708186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:02.708604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:02.769621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:02.772996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:02.778408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e175df32-94b2-452d-83e0-030bced59892 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082836 Sep 01 08:33:02.778976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2011/4051] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:02 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:03.303065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:03.303674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:03.310473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:03.310947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:03.311378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:03.312052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:03.312499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:03.312915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:03.377943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:03.386690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8dca6e77-6733-47a2-9c57-229ee0dc0477 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087304 Sep 01 08:33:03.387184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2041/4052] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:03 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:03.798882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:03.799470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:03.805812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:03.806939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:03.807370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:03.808076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:03.808524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:03.808938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:03.869440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:03.877199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ba97acb7-bd9e-4e5e-a5cc-a83abaae55e8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082124 Sep 01 08:33:03.877758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2012/4053] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:03 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:04.407754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:04.408392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:04.410286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=56 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:04.415337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:04.415812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:04.416243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:04.416924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:04.417371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:04.417792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:04.480112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:04.487749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7bfc1aab-1182-47a2-9220-1a28c020b247 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083818 Sep 01 08:33:04.488313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2042/4054] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:04 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:04.898524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:04.899133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:04.905703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:04.906181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:04.906650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:04.907331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:04.907780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:04.908237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:04.967934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:04.975354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8aadcbbe-ab6c-495d-8c62-d25fb6ec9d64 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080725 Sep 01 08:33:04.975901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2013/4055] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:04 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:05.508599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:05.509205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:05.515789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:05.516270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:05.516703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:05.517384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:05.517835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:05.518276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:05.578210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:05.586319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f25967c-c171-4c33-9081-dabbf0891182 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081572 Sep 01 08:33:05.586885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2043/4056] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:05 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:05.996617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:05.997248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:06.003292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:06.003765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:06.004189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:06.004858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:06.005302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:06.005716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:06.065950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:06.072685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-563dfbc2-286c-4787-9049-587f420efb93 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080483 Sep 01 08:33:06.073247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2014/4057] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:05 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:06.608111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:06.609576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:06.615750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:06.616225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:06.616653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:06.617328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:06.617768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:06.618184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:06.681100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:06.688805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7954d32-865b-4e13-9b59-2d16ce638364 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085291 Sep 01 08:33:06.689357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2044/4058] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:06 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:07.093888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:07.094530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:07.100542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:07.101021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:07.101447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:07.102122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:07.102591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:07.103696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:07.162438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:07.170610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b5b71944-7a82-4828-b786-c1526b68ee40 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080486 Sep 01 08:33:07.171173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2015/4059] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:07 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:07.710038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:07.710738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:07.717452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:07.717926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:07.718383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:07.719066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:07.719512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:07.719928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:07.779641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:07.787134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-585a9ce3-e98a-4e47-af3c-fc2cfdce0d8a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080861 Sep 01 08:33:07.787690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2045/4060] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:07 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:08.190858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:08.191457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:08.193301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=56 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:08.199007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:08.199488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:08.199925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:08.200605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:08.201047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:08.201474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:08.261967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:08.269498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-792ed92a-2721-42af-96b1-848251b5e1d9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082472 Sep 01 08:33:08.270054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2016/4061] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:08 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:08.808833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:08.809448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:08.815416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:08.815893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:08.816326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:08.817004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:08.817450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:08.817869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:08.879442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:08.887028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ba96e326-bb57-46ee-a8ae-4c4b0e635b6c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082666 Sep 01 08:33:08.887586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2046/4062] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:08 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:09.291188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:09.291883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:09.297799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:09.298285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:09.298736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:09.299412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:09.299858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:09.300276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:09.359229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:09.366724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c709fee6-7478-4f32-b2d5-5ffbfc2af7c4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079943 Sep 01 08:33:09.367284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2017/4063] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:09 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:09.907886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:09.909765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:09.914454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:09.914926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:09.915356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:09.916137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:09.916583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:09.916999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:09.977863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:09.985811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6c94e142-5d46-4fc9-b4ba-7f0aa5c68231 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081788 Sep 01 08:33:09.986441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2047/4064] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:09 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:10.387313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:10.388037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:10.393844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:10.394354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:10.394795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:10.395482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:10.395933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:10.396350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:10.456089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:10.463862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc785f09-dcd7-4bba-b696-bb99fecc73c2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080509 Sep 01 08:33:10.464428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2018/4065] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:10 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:11.006972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:11.007531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:11.014468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:11.014945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:11.015378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:11.016062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:11.016513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:11.016935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:11.080039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:11.088153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ef7ea54-eb0a-4e1e-b25c-37074eb37bec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084714 Sep 01 08:33:11.088741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2048/4066] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:11 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:11.485559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:11.486176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:11.492413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:11.492996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:11.493370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:11.494093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:11.494561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:11.494978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:11.563154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:11.570989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a5540ab3-f814-4f4a-a916-ac04c6ac080a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089222 Sep 01 08:33:11.571566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2019/4067] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:11 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:12.109266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:12.109884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:12.115879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:12.116356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:12.116778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:12.117452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:12.117924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:12.118377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:12.180134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:12.188194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b63bc855-387f-43e0-8657-3d59177378fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082812 Sep 01 08:33:12.188769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2049/4068] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:12 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:12.594185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:12.594831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:12.600999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:12.601423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:12.601852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:12.602574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:12.603026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:12.603442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:12.663016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:12.670609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9b09c63c-7e0d-46d0-8686-2d7fd9bd6110 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080217 Sep 01 08:33:12.671168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2020/4069] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:12 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:13.209650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:13.210252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:13.216837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:13.217313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:13.217745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:13.218456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:13.218903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:13.219412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:13.281121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:13.288531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd75d935-e58b-44ff-8536-f0f15be69e76 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082816 Sep 01 08:33:13.289091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2050/4070] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:13 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:13.691445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:13.692055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:13.698700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:13.699180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:13.699607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:13.700285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:13.700828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:13.701152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:13.760972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:13.768518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd28bbfd-7109-407a-9828-8c9112243fb0 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080906 Sep 01 08:33:13.769073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2021/4071] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:13 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:14.309351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:14.309950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:14.315893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:14.316364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:14.316794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:14.317463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:14.317907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:14.318350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:14.380322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:14.388014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a817e8cf-0cec-4e79-86cf-be19509b08e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083069 Sep 01 08:33:14.388570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2051/4072] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:14 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:14.788802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:14.789406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:14.795412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:14.795882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:14.796306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:14.796974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:14.797414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:14.797863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:14.856910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:14.864452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8d3e3a1e-5459-4d1c-8b87-960e3af0d3bb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079478 Sep 01 08:33:14.865010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2022/4073] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:14 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:15.410109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:15.410770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:15.416622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:15.417119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:15.418125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:15.418842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:15.419290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:15.419709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:15.486542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:15.495028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-479673c0-edf7-4bf3-9cb2-9b80dbd0e39b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088598 Sep 01 08:33:15.495709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2052/4074] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:15 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:15.884909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:15.885514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:15.892052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:15.892528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:15.892956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:15.893622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:15.894069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:15.894506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:15.953098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:15.960876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a1e72a98-aeab-48c9-9fe4-35dd467f4a6a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079898 Sep 01 08:33:15.961431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2023/4075] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:15 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:16.515055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:16.515658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:16.521622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:16.522095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:16.522563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:16.523252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:16.523700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:16.524125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:16.585069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:16.593765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee3293c2-256e-4aa7-b233-eb8b401902bb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082613 Sep 01 08:33:16.594350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2053/4076] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:16 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:16.982214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:16.982858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:16.989069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:16.989545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:16.989975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:16.990693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:16.991136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:16.991552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:17.051011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:17.059742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4767852-334e-4eba-b084-1d03eef2081d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081973 Sep 01 08:33:17.060329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2024/4077] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:16 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:17.614918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:17.615531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:17.621533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:17.621998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:17.622648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:17.623320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:17.623767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:17.624179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:17.685962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:17.693839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1dac3476-1a10-4f1e-8109-abf5eab39188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082737 Sep 01 08:33:17.694426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2054/4078] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:17 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:18.081289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:18.081874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:18.087840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:18.088319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:18.088751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:18.093160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:18.093638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:18.094078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:18.155444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:18.163239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a23b78c-3308-4abb-abec-48f296f74519 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086090 Sep 01 08:33:18.163800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2025/4079] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:18 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:18.715875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:18.716485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:18.723608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:18.723988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:18.724411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:18.725096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:18.725544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:18.725955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:18.786106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:18.793610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-818f5c8d-884b-41c4-9055-8077846acdbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082501 Sep 01 08:33:18.794165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2055/4080] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:18 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:19.184652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:19.185251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:19.191117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:19.191586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:19.192010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:19.192680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:19.193123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:19.193538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:19.253203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:19.260609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-59c1ab62-66d0-4a6d-ae4a-5b7288de15c5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080492 Sep 01 08:33:19.261400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2026/4081] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:19 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:19.813469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:19.814060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:19.819947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:19.820415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:19.820847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:19.821516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:19.821957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:19.822400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:19.885827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:19.894131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f880a6b0-b6a4-4b0a-ad45-3199e6fcbd52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084563 Sep 01 08:33:19.894722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2056/4082] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:19 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:20.281472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:20.282327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:20.288363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:20.288851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:20.289272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:20.289956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:20.290438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:20.290859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:20.357742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:20.365327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-58e68932-82e9-4f77-a147-a4ed3b998006 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.088125 Sep 01 08:33:20.365878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2027/4083] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:20 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:20.914919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:20.915490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:20.921482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:20.921954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:20.922407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:20.923091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:20.923532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:20.923946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:20.941276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:20.984926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:20.992409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc2142fa-601a-4cd3-9183-300e5f31cbb7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081421 Sep 01 08:33:20.992959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2057/4084] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:20 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:21.386746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:21.387341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:21.393513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:21.393986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:21.394445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:21.395122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:21.395569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:21.395982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:21.414676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:21.457328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:21.465553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8be8f2fd-115b-48b0-b6fe-f0c33320e966 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083397 Sep 01 08:33:21.466111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2028/4085] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:21 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:22.013075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:22.013722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:22.019669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:22.020138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:22.020564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:22.021231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:22.021675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:22.022089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:22.084365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:22.092402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-895efc6b-94fb-400c-a785-415e1aaaf361 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083404 Sep 01 08:33:22.092958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2058/4086] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:22 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:22.486249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:22.486884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:22.492958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:22.493435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:22.493862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:22.494609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:22.495090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:22.495695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:22.554410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:22.562037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-05ac0c8e-bb12-45db-9706-7b3ebeeb081e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079607 Sep 01 08:33:22.562624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2029/4087] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:22 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:23.113134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:23.113749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:23.119834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:23.120316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:23.120751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:23.121451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:23.121908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:23.122356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:23.183245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:23.191281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28a3fab4-29d0-4367-876c-a1adae6ddc5b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082067 Sep 01 08:33:23.191845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2059/4088] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:23 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:23.584242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:23.584971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:23.591129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:23.591603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:23.592031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:23.592712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:23.593153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:23.593569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:23.652512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:23.660034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-811ac3bd-ab0f-480f-8e9e-02e71d3de993 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079588 Sep 01 08:33:23.660580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2030/4089] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:23 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:24.213079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:24.213667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:24.220495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:24.220982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:24.221406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:24.222099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:24.222568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:24.222989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:24.284878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:24.292469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1cfb3045-f9ef-4557-bbb6-1f0b8d308502 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083313 Sep 01 08:33:24.293625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2060/4090] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:24 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:24.680493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:24.681038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:24.687306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:24.687778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:24.688205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:24.688873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:24.689314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:24.689781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:24.750364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:24.757969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-434bfdb0-1f3e-4f11-932e-dd451df13721 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081424 Sep 01 08:33:24.758589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2031/4091] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:24 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:25.313834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:25.314477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:25.320368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:25.320841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:25.321263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:25.321942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:25.322414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:25.322836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:25.381797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:25.389816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b02d2a77-d718-4762-949f-aff3bb529b4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080659 Sep 01 08:33:25.390391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2061/4092] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:25 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:25.779006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:25.779576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:25.785497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:25.785966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:25.786423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:25.787385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:25.787825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:25.788241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:25.848052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:25.855596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d6eac978-93d0-4d1e-83b5-671159d3f165 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080758 Sep 01 08:33:25.856159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2032/4093] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:25 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:26.410374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:26.410937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:26.417044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:26.417525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:26.417957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:26.418712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:26.419257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:26.419787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:26.484963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:26.492607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-88f758a7-d12b-4e0c-9c4c-6159da8c268f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086194 Sep 01 08:33:26.493172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2062/4094] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:26 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:26.877094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:26.877726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:26.883654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:26.884130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:26.884563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:26.885234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:26.885676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:26.886087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:26.944864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:26.953103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61dce0de-9c22-4a17-aeb1-c830dcbb01f9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080642 Sep 01 08:33:26.953661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2033/4095] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:26 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:27.517903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:27.518525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:27.524631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:27.525107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:27.525538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:27.526230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:27.526706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:27.527125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:27.587972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:27.596316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c1143ca4-def2-4c2d-bd41-c291eaa13cc1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082268 Sep 01 08:33:27.596867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2063/4096] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:27 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:27.974327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:27.974938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:27.981023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:27.981601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:27.982037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:27.982754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:27.983204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:27.983625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:28.042385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:28.050239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e392d9df-3241-4c8f-b43c-363cef47d9e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079852 Sep 01 08:33:28.050821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2034/4097] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:27 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:28.617230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:28.617856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:28.624608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:28.625095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:28.625526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:28.626216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:28.626692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:28.627113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:28.690307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:28.698013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f288518f-90aa-467f-9fee-7034f959b4dc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084624 Sep 01 08:33:28.698614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2064/4098] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:28 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:29.071609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:29.072218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:29.078084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:29.078586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:29.079285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:29.079953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:29.080396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:29.080810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:29.140665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:29.148363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d9d47803-0818-4f87-847e-b966330a4318 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080566 Sep 01 08:33:29.148927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2035/4099] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:29 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:29.720479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:29.721084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:29.727362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:29.727867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:29.728200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:29.728978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:29.729349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:29.729777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:29.791478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:29.799313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b32fb65-67aa-4f9b-9723-b02e677de32c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083471 Sep 01 08:33:29.799879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2065/4100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:29 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:30.169838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:30.170673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:30.176393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:30.176864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:30.177291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:30.177957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:30.178427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:30.178844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:30.238444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:30.246094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-85bb0f4d-717f-408d-b7f7-50b34f3a4a98 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080816 Sep 01 08:33:30.246687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2036/4101] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:30 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:30.819983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:30.820591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:30.827556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:30.828046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:30.828477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:30.829424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:30.829899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:30.830340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:30.893392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:30.900966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dfe29f8d-590c-4091-afb6-bfcd54dc68d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084906 Sep 01 08:33:30.901522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2066/4102] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:30 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:31.265875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:31.266492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:31.272468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:31.272946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:31.273371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:31.274046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:31.274516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:31.274936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:31.334651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:31.342279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fa6ea108-6792-4c1b-ad59-66b2bfd5ff7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080191 Sep 01 08:33:31.342837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2037/4103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:31 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:31.921600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:31.922202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:31.928506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:31.928979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:31.929409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:31.930103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:31.930580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:31.931008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:31.991113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:31.999350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e06b98cc-d216-4836-8482-927a7d5554a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082180 Sep 01 08:33:31.999909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2067/4104] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:31 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:32.362543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:32.363159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:32.369131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:32.369615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:32.370050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:32.370765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:32.371214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:32.371640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:32.434688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:32.442533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2267a974-6335-4975-9cdc-26a59c5841f8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083814 Sep 01 08:33:32.443093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2038/4105] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:32 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:33.020158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:33.020734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:33.026924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:33.027168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:33.027599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:33.028289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:33.029262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:33.029676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:33.097312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:33.104919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a843bd8c-fa35-427e-a86c-3bbbe62f5ba7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088726 Sep 01 08:33:33.105483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2068/4106] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:33 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:33.464437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:33.465133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:33.472279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:33.473277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:33.473277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:33.474061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:33.474540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:33.474972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:33.535275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:33.542731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b8f321cc-3fc7-4d08-a5f2-6af06da8e143 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083444 Sep 01 08:33:33.543284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2039/4107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:33 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:34.126457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:34.127095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:34.136131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:34.136611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:34.137041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:34.137788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:34.138239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:34.139006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:34.218859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:34.227112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ebd1e75d-e4e6-4f0e-bfc4-cf783f70556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.104667 Sep 01 08:33:34.227676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2069/4108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:34 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:34.564262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:34.564926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:34.572444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:34.572934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:34.573356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:34.574084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:34.574573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:34.574992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:34.638450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:34.646930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b7c01c4f-73d1-422b-8a05-60bda8eb2250 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086951 Sep 01 08:33:34.647501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2040/4109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:34 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:35.248495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:35.249088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:35.250954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=56 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:35.256205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:35.256689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:35.257115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:35.257801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:35.258242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:35.258682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:35.322571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:35.331041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f3f1e07-1d49-4e22-ac1d-dcbf7154d49e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086365 Sep 01 08:33:35.331602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2070/4110] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:35 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:35.667509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:35.668117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:35.674589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:35.675063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:35.675490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:35.676160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:35.676604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:35.677020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:35.738481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:35.746056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c7d141b7-2f7f-4d21-9805-99cad0b5654a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082451 Sep 01 08:33:35.746850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2041/4111] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:35 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:36.351795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:36.352531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:36.359545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:36.360028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:36.360459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:36.361160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:36.361622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:36.362022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:36.426972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:36.434667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7c4ec1de-1032-4c87-b3ae-b095475b38ca tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086588 Sep 01 08:33:36.435627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2071/4112] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:36 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:36.768165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:36.768796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:36.774718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:36.775193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:36.775619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:36.776287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:36.776737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:36.777153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:36.837248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:36.845545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15e9d5af-01ca-4904-ae4d-65dc924cba24 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081775 Sep 01 08:33:36.846101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2042/4113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:36 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:37.479129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:37.479739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:37.485798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:37.486309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:37.486746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:37.487426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:37.487868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:37.488288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:37.550215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:37.557877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5251a06-6742-4694-a5b0-a4aacb9135eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082528 Sep 01 08:33:37.558490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2072/4114] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:37 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:37.867010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:37.867617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:37.873659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:37.874129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:37.874586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:37.875259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:37.875701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:37.876119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:37.934685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:37.942194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9e50e14e-cfb9-4909-adb7-2baba75d45d8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079131 Sep 01 08:33:37.942771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2043/4115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:37 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:38.580545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:38.581161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:38.587234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:38.587716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:38.588147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:38.588837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:38.589305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:38.589704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:38.653004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:38.661011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e51fd5cc-bf0c-4eb4-bcd0-eb6965ee4e53 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085394 Sep 01 08:33:38.661585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2073/4116] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:38 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:38.963803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:38.964406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:38.966521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=56 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:38.971575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:38.972050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:38.972481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:38.973151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:38.973592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:38.974007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:39.033724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:39.041261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a703a1a-4a54-4a53-b967-c9bdbedf67af tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081303 Sep 01 08:33:39.041811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2044/4117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:38 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:39.681489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:39.682189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:39.688310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:39.688784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:39.689215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:39.689891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:39.690381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:39.690802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:39.694705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:39.755315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:39.762941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ab527718-1bb9-4b5d-944b-c3a84a28a762 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085221 Sep 01 08:33:39.764086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2074/4118] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:39 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:40.063425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:40.064036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:40.070135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:40.070640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:40.071068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:40.071775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:40.072216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:40.072631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:40.078309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:40.134865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:40.143189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d3eab6a4-a54b-4ca0-96da-113a1cb164ba tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084197 Sep 01 08:33:40.143756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2045/4119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:40 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:40.784842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:40.785482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:40.791501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:40.791986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:40.792422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:40.793102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:40.793579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:40.794008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:40.853479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:40.861960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-047d6835-4dec-49b5-abb1-e8c8e470d1c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080852 Sep 01 08:33:40.862590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2075/4120] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:40 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:41.163635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:41.164266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:41.171142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:41.171643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:41.172066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:41.172738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:41.173181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:41.173593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:41.233730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:41.241361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-064658c7-c4c7-40d9-bb6e-99cb43fa0789 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081484 Sep 01 08:33:41.241920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2046/4121] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:41 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:41.882557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:41.883314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:41.889736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:41.890209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:41.890692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:41.891373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:41.891819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:41.892238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:41.955612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:41.966147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-42a48d63-b127-4833-a5d1-867c73abba02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086938 Sep 01 08:33:41.968427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2076/4122] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:41 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:42.262669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:42.263305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:42.269904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:42.270416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:42.270846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:42.271522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:42.271966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:42.272384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:42.331598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:42.339198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4fc27cae-f029-4861-8f03-24e30990c808 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080400 Sep 01 08:33:42.339763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2047/4123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:42 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:42.989494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:42.990053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:42.995916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:42.996391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:42.996822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:42.997786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:42.998605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:42.999136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:43.058245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:43.066528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-218a74dd-fbd2-43e0-a893-fa6f6f3e6a40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080852 Sep 01 08:33:43.067106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2077/4124] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:42 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:43.359693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:43.360301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:43.366237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:43.366746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:43.367182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:43.367864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:43.368314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:43.368736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:43.427677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:43.435356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-302aff2d-c837-4c6f-aa93-f83b1ca8712b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079554 Sep 01 08:33:43.435976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2048/4125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:43 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:44.087733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:44.088358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:44.094516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:44.094989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:44.095499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:44.096176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:44.096618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:44.097031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:44.308087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:44.315841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-405dd038-e950-4a04-b88b-9315c8f613ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.231925 Sep 01 08:33:44.316404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2078/4126] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:44 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:44.456334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:44.456888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:44.462739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:44.463219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:44.463648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:44.464328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:44.464776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:44.465196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:44.524379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:44.533003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-31cfb64f-f894-4df9-9af3-5701be3d7652 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080931 Sep 01 08:33:44.533560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2049/4127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:44 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:45.336142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:45.336767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:45.343725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:45.344194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:45.344618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:45.345303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:45.345744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:45.346156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:45.405691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:45.413219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4bd211a4-5063-46e3-bc21-8f4a58c0d733 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080901 Sep 01 08:33:45.413774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2079/4128] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:45 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:45.555001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:45.555707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:45.561407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:45.561873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:45.562336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:45.563008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:45.563449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:45.563868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:45.625495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:45.633247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-796ac195-111e-46eb-8ffd-cd40487bcdcb tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082137 Sep 01 08:33:45.633812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2050/4129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:45 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:46.434016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:46.434689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:46.441152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:46.441629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:46.442065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:46.442787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:46.443243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:46.443666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:46.515659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:46.523660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b4065f21-eb5d-4760-b486-d2e15ef23503 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.093512 Sep 01 08:33:46.524221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2080/4130] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:46 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:46.656084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:46.656695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:46.662603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:46.663086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:46.663519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:46.664196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:46.664648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:46.665071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:46.724729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:46.732300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47880014-9518-4c08-8930-3760348f6425 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080173 Sep 01 08:33:46.732932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2051/4131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:46 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:47.544223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:47.544824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:47.550991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:47.551467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:47.551893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:47.552587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:47.553034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:47.553446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:47.614281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:47.621795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f5f6192a-e0c0-4d27-aa34-143d16f83fd9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081411 Sep 01 08:33:47.622325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2081/4132] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:47 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:47.753648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:47.754191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:47.760029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:47.760499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:47.760923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:47.761587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:47.762033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:47.762472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:47.820712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:47.828194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dcf451d1-838f-4cd0-b9ee-b4ffbbeb531b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.078413 Sep 01 08:33:47.829181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2052/4133] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:47 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:48.643295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:48.643918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:48.650830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:48.651337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:48.651779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:48.652483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:48.652964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:48.653391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:48.716127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:48.723719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6adca28-f6c2-4450-9413-4be5dff81694 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084816 Sep 01 08:33:48.724215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2082/4134] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:48 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:48.850274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:48.851050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:48.858141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:48.858994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:48.859467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:48.860409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:48.860615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:48.861165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:48.924431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:48.931932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-10444cce-8fd7-483e-9049-fc750bb511f7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086603 Sep 01 08:33:48.932486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2053/4135] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:48 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:49.744822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:49.745396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:49.751599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:49.752074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:49.752496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:49.753313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:49.753760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:49.754170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:49.814150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:49.821679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6cf52dcc-baa8-4b08-af5a-f3110538b9ed tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080847 Sep 01 08:33:49.822236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2083/4136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:49 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:49.953191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:49.954100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:49.960100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:49.960573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:49.960999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:49.961672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:49.962114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:49.962676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:50.021363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:50.028850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b66b031-446b-4d5b-ac8d-ec29f450b4bd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080050 Sep 01 08:33:50.029982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2054/4137] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:49 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:50.842757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:50.843395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:50.853376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:50.853864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:50.854330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:50.855036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:50.855482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:50.855904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:50.919270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:50.927552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1eff8706-0b95-42c0-a2f9-099e4797749c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088880 Sep 01 08:33:50.928109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2084/4138] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:50 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:51.050790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:51.051388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:51.057236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:51.057713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:51.058143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:51.058843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:51.059283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:51.059700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:51.119060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:51.126879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ebea5152-a622-4157-8e23-c246ce3cd560 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079942 Sep 01 08:33:51.127454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2055/4139] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:51 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:33:51.948962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:51.949595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:51.956168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:51.956646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:51.957076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:51.957777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:51.958288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:51.958716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:52.019328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:52.026872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c89eff01-4146-433c-a5ba-e626ceff8e26 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081791 Sep 01 08:33:52.027425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2085/4140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:51 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:52.147686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:52.148295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:52.155219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:52.155877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:52.156319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:52.157001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:52.157458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:52.157881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:52.217652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:52.225516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a10f8f2a-eb22-4ac9-bc31-3d47bbf834ce tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081810 Sep 01 08:33:52.226075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2056/4141] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:52 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:53.047659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:53.048350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:53.054472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:53.054962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:53.055835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:53.056102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:53.056555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:53.056983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:53.122067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:53.130030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e1f6a73f-d58e-4d05-a9b1-7bb6c2b9eb79 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086205 Sep 01 08:33:53.130638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2086/4142] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:53 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:53.245847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:53.246504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:53.253336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:53.253817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:53.254252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:53.254980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:53.255432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:53.255851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:53.315511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:53.323156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80878c79-dfde-48de-9f42-0a2aff114810 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081188 Sep 01 08:33:53.323717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2057/4143] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:53 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:54.151524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:54.152132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:54.159043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:54.159517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:54.159937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:54.160628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:54.161067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:54.161481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:54.222070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:54.229628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-42a09ddb-9c4f-454f-b780-dab0f795461b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081998 Sep 01 08:33:54.230183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2087/4144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:54 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:54.345105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:54.345707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:54.351622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:54.352095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:54.352532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:54.353206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:54.353653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:54.354071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:54.413942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:54.421951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ad7aed7-31ba-4e7a-b579-9b44be3c505d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080950 Sep 01 08:33:54.422659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2058/4145] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:54 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:55.250838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:55.251491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:55.257469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:55.257944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:55.258415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:55.259114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:55.259540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:55.259954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:55.322940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:55.331270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e0d1996-1c68-4534-90f3-73ce474f93ae tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084376 Sep 01 08:33:55.331826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2088/4146] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:55 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:55.442946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:55.443612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:55.449392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:55.449870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:55.450335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:55.451578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:55.452034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:55.452512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:55.514444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:55.522270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b00105c-e561-4ab9-a8b0-aafd63f47e29 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083158 Sep 01 08:33:55.522818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2059/4147] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:55 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:56.352820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:56.353457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:56.360236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:56.360737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:56.361155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:56.361846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:56.362350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:56.362766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:56.422363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:56.430289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fb204edd-f399-4bfb-bd0f-69cdcf2976b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081204 Sep 01 08:33:56.430854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2089/4148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:56 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:56.543351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:56.543957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:56.550758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:56.551230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:56.551654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:56.552330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:56.552770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:56.553184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:56.613181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:56.621064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-90b9ad46-bcb0-4621-8ad1-7352bda02764 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081495 Sep 01 08:33:56.621795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2060/4149] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:56 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:57.453365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:57.454288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:57.460308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:57.460787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:57.461228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:57.461924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:57.462405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:57.462829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:57.525547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:57.528926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:57.533928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8825751a-0a73-4a28-a9f3-c33db62771e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085189 Sep 01 08:33:57.534522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2090/4150] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:57 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:57.641816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:57.642444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:57.648346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:57.648817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:57.649246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:57.649928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:57.650417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:57.650833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:57.711807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:57.715155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:57.720192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-53d2aea6-965d-4589-a40f-f19dda32e04e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082235 Sep 01 08:33:57.720764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2061/4151] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:57 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:58.554582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:58.555190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:58.561985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:58.562760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:58.562976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:58.563668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:58.564113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:58.564530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:58.625868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:58.633342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-56eb76be-2e3d-473a-b166-b04d97446379 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082706 Sep 01 08:33:58.633899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2091/4152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:58 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:58.741138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:58.741676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:58.748609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:58.749149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:58.749584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:58.750291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:58.750819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:58.751175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:58.809618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:58.817900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc93ae50-6967-418e-ae09-6d6936beb780 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080656 Sep 01 08:33:58.818484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2062/4153] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:58 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:59.655355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:59.656068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:59.662113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:59.662605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:59.663095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:59.663713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:59.664313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:59.664564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:59.728490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:59.737384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-08874935-2954-4d66-a40b-16f6683fe2de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086556 Sep 01 08:33:59.738160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2092/4154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:59 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:33:59.839026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:33:59.839608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:33:59.845555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:59.846030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:59.846494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:59.847166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:33:59.847607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:33:59.848048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:33:59.907677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:33:59.915317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48ce17ea-1f32-4781-aa7b-5944815d661e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080117 Sep 01 08:33:59.915875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2063/4155] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:33:59 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:00.759021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:00.759828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:00.766629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:00.767107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:00.767540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:00.768231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:00.768676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:00.769094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:00.829358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:00.837017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f137d19f-eb33-43e3-a11c-73738267fc87 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082117 Sep 01 08:34:00.837580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2093/4156] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:00 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:00.937242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:00.937840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:00.943829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:00.944309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:00.944721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:00.945388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:00.945828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:00.946241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:01.005260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:01.012912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-66fbcf0c-8ad7-4556-9ac8-16fbe3b5759f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.079963 Sep 01 08:34:01.013402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2064/4157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:00 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:01.857992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:01.858992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:01.865505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:01.865985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:01.866456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:01.867154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:01.867609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:01.868032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:01.931352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:01.939554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-676fa0bf-4df9-4a48-9d81-fcde5f41915f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.086115 Sep 01 08:34:01.940109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2094/4158] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:01 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:02.034018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:02.034672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:02.040520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:02.040988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:02.041413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:02.042081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:02.042552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:02.042969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:02.102330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:02.110498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4115b282-a69f-46b9-b530-2b69e8248275 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080219 Sep 01 08:34:02.110988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2065/4159] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:02 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:02.960303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:02.960961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:02.967397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:02.967963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:02.968394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:02.969095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:02.969542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:02.969955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:03.032433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:03.041012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3320bba-8f3b-46a9-819f-9af877dae542 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084490 Sep 01 08:34:03.041691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2095/4160] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:02 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:03.131400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:03.132027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:03.138026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:03.139458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:03.139897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:03.140866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:03.141053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:03.141919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:03.203385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:03.211619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1e6df68f-f9d7-497c-aa5c-8e702908eddf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083841 Sep 01 08:34:03.212117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2066/4161] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:03 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:04.063717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:04.065017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:04.075484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:04.076929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:04.077706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:04.079204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:04.080023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:04.080792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:04.150248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:04.159038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ed6046d2-995f-4f03-ad4a-1b73617c7c97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.100530 Sep 01 08:34:04.159612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2096/4162] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:04 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:04.233606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:04.234536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:04.240805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:04.241868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:04.242394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:04.243193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:04.243601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:04.244028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:04.312914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:04.320771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e4231a5-f15a-4bc3-9b42-2236b0690b4e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.092032 Sep 01 08:34:04.321625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2067/4163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:04 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:05.180261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:05.180945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:05.187370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:05.187857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:05.188279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:05.188984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:05.189421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:05.189841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:05.259923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:05.268534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c9136ab9-4cb6-4df4-abbf-56671d5d114c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.092053 Sep 01 08:34:05.269538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2097/4164] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:05 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:05.342289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:05.343038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:05.349166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:05.349647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:05.350080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:05.350813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:05.351263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:05.351682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:05.413932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:05.422636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb620806-85b0-455c-a797-52584bd1c2b5 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084702 Sep 01 08:34:05.423211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2068/4165] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:05 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:06.289156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:06.290432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:06.291662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=56 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:06.297082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:06.297556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:06.297983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:06.298720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:06.299163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:06.299587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:06.363186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:06.370721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f6e36507-e239-44a6-80af-cfe664d1998d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085509 Sep 01 08:34:06.371273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2098/4166] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:06 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:06.443243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:06.443966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:06.449700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:06.450174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:06.450631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:06.451313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:06.451912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:06.452331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:06.512594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:06.520174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-43cd9ca6-e445-44b1-8d56-1c78b7ec8a9c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080927 Sep 01 08:34:06.520741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2069/4167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:06 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:07.392343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:07.392978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:07.399037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:07.399517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:07.399943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:07.400633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:07.401076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:07.401492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:07.462621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:07.470842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2f752f9-c0f4-4c22-b18a-3ce2ea368193 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083069 Sep 01 08:34:07.471410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2099/4168] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:07 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:07.540910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:07.541516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:07.548298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:07.548779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:07.549212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:07.557740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:07.557740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:07.557740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:07.610860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:07.618328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c6a44234-2e0c-441d-90a9-e9387811a877 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081262 Sep 01 08:34:07.618884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2070/4169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:07 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:08.492616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:08.493222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:08.499458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:08.499940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:08.500374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:08.501073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:08.501524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:08.501942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:08.564932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:08.572506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-145df35e-af77-4df3-a8c6-c8d44c79bb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083713 Sep 01 08:34:08.573070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2100/4170] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:08 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:08.639750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:08.640341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:08.646272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:08.646755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:08.647189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:08.647863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:08.648307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:08.648721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:08.710400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:08.717918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-49abc47b-c939-476d-8731-4c066dd05cf3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082895 Sep 01 08:34:08.718503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2071/4171] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:08 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:09.593680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:09.594365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:09.600849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:09.601325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:09.601983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:09.602717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:09.603164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:09.603587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:09.665863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:09.674225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6637d068-4b92-4da0-bbfe-b35eafccef29 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085146 Sep 01 08:34:09.674912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2101/4172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:09 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:09.739025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:09.739628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:09.741849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=56 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:09.747258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:09.748415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:09.748848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:09.749526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:09.749970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:09.750411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:09.809454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:09.816969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-167c36e4-7ce8-4879-bce1-4d9da4d341cf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081939 Sep 01 08:34:09.817523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2072/4173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:09 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:10.695220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:10.696176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:10.702542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:10.703026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:10.703718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:10.704406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:10.704850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:10.705337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:10.774341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:10.782282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-896fd792-0f0b-4023-a9c0-7cc22d7fc8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.090863 Sep 01 08:34:10.782854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2102/4174] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:10 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:10.837136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:10.837748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:10.843959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:10.844431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:10.844863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:10.845567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:10.845999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:10.846446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:10.906176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:10.913916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0147e18c-73f6-4ff3-aaf2-33c653e85f13 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080468 Sep 01 08:34:10.914518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2073/4175] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:10 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:11.802051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:11.802693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:11.808710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:11.809185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:11.809611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:11.810374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:11.810980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:11.811394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:11.872786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:11.880618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9442eb8b-1dee-4f58-8820-846dd7660e2e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082458 Sep 01 08:34:11.881179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2103/4176] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:11 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:11.934939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:11.935539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:11.941507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:11.941991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:11.942462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:11.943142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:11.943592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:11.944011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:12.005072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:12.012557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e17046fb-628e-40ef-a4eb-0523adfd6da9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081446 Sep 01 08:34:12.013111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2074/4177] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:11 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:12.901320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:12.902050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:12.909453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:12.909939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:12.910403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:12.911101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:12.911552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:12.911977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:12.976335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:12.984505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5fcd4c65-f7d5-460d-a26e-5b13cd2afc0d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087068 Sep 01 08:34:12.985455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2104/4178] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:12 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:13.033177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:13.033800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:13.039710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:13.040183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:13.040616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:13.041293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:13.041743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:13.042162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:13.102601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:13.110738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47ccde6a-ecae-4f3c-8649-5ae1dbeab584 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081580 Sep 01 08:34:13.111305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2075/4179] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:13 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:14.008807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:14.009449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:14.015384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:14.015853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:14.016278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:14.016958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:14.017429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:14.017844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:14.077473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:14.085238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-98104bab-2d17-40ba-bc66-356a075fc7a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080318 Sep 01 08:34:14.085794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2105/4180] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:14 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:14.131767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:14.132363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:14.138385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:14.138866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:14.139304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:14.139986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:14.140441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:14.140862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:14.200955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:14.208740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7c35a7be-006b-4a8e-b810-23e535b13c25 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080812 Sep 01 08:34:14.209299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2076/4181] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:14 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:15.105595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:15.106317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:15.113661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:15.114141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:15.114703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:15.115403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:15.115851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:15.116274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:15.181155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:15.188909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c7f5b2d-9417-419d-bf6a-86e3443c2b39 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.087154 Sep 01 08:34:15.189457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2106/4182] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:15 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:15.229095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:15.229688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:15.236614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:15.237089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:15.237518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:15.238197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:15.238676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:15.239100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:15.298524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:15.306083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-74133275-bdf0-4c5a-ab2d-01aac5de955f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080773 Sep 01 08:34:15.306680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2077/4183] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:15 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:16.209304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:16.209918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:16.215999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:16.217164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:16.217934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:16.218666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:16.219119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:16.219540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:16.237681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:16.281165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:16.288869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a80cf722-849c-466a-a088-6b0914eb18ba tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083420 Sep 01 08:34:16.289427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2107/4184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:16 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:16.327551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:16.328165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:16.334392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:16.334878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:16.335314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:16.335995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:16.336447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:16.336871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:16.355100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:16.400004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:16.408759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2277e722-b6dc-422a-8c36-8ef524a12b09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085789 Sep 01 08:34:16.409322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2078/4185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:16 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:17.309455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:17.310116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:17.316178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:17.316644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:17.317064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:17.317746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:17.318191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:17.318640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:17.381738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:17.389478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac810ed3-2f6b-4a21-9ee1-007dfa33c2b2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083829 Sep 01 08:34:17.390035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2108/4186] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:17 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:17.428784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:17.429389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:17.435350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:17.435825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:17.436254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:17.436932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:17.437383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:17.437804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:17.497856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:17.505418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ffad8f2b-b716-4723-af09-131723c1a414 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080486 Sep 01 08:34:17.505976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2079/4187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:17 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:18.409849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:18.410454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:18.416556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:18.417032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:18.417461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:18.418175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:18.418645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:18.419059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:18.480120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:18.488334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28690302-ca9e-4092-a2db-5f8d703dbd9f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082480 Sep 01 08:34:18.488888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2109/4188] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:18 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:18.526005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:18.526640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:18.532706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:18.533187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:18.533622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:18.534329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:18.534783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:18.535203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:18.596280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:18.603955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-969df4d4-3942-4717-b793-6ea8219eb7b4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081834 Sep 01 08:34:18.604513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2080/4189] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:18 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:19.510713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:19.511316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:19.517905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:19.518417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:19.518845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:19.519531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:19.519971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:19.520417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:19.583203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:19.590758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-da276f65-8487-4c09-883c-587b1b8d83fd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083924 Sep 01 08:34:19.591741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2110/4190] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:19 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:19.625891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:19.626514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:19.632431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:19.632903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:19.633331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:19.634028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:19.634505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:19.634922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:19.694592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:19.702876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd161ca2-05e7-4786-ab3b-5843b6ad46dd tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081264 Sep 01 08:34:19.703535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2081/4191] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:19 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:20.613672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:20.614310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:20.620437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:20.620916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:20.621338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:20.622018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:20.622694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:20.623107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:20.684540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:20.692135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-948e9d5e-03b9-42da-81a0-16439f6a2814 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083132 Sep 01 08:34:20.692695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2111/4192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:20 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:20.724003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:20.724551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:20.730477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:20.730952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:20.731379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:20.732612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:20.733065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:20.733473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:20.793784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:20.801921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8d290f72-eb86-45ac-a201-c3889277cdd6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081938 Sep 01 08:34:20.802507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2082/4193] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:20 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:21.713817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:21.714460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:21.721242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:21.721774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:21.722153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:21.722874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:21.723321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:21.723740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:21.786609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:21.794053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-35d5463e-2bb4-481a-a960-10ba3d4e5781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084212 Sep 01 08:34:21.795270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2112/4194] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:21 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:21.823365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:21.823978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:21.830377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:21.830854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:21.831279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:21.831953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:21.832396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:21.832812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:21.893888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:21.901412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f39d2e18-39a2-41a8-a0b0-242796a652e7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081862 Sep 01 08:34:21.901958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2083/4195] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:21 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:22.815374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:22.816181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:22.823610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:22.824091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:22.824517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:22.825219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:22.825732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:22.826439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:22.891831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:22.899634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-258e6f41-935f-480e-8719-9487728a88f4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.088468 Sep 01 08:34:22.900245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2113/4196] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:22 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:22.924358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:22.924972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:22.931496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:22.931986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:22.932433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:22.933164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:22.933614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:22.934046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:22.996472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:23.004378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3ef90e6-8974-4d9f-997b-8d387440b0e1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084116 Sep 01 08:34:23.004951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2084/4197] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:22 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:23.921789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:23.922416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:23.928423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:23.928920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:23.929350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:23.930031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:23.930512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:23.930930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:23.992796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:24.001254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a27d7f23-2546-4e7f-b6b3-b53fed99556a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.083891 Sep 01 08:34:24.001818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2114/4198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:23 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:24.025004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:24.025616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:24.032331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:24.032804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:24.033232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:24.033915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:24.034394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:24.034820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:24.097208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:24.104996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d8fc16b5-e039-41fc-94fb-47818c40bdf6 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083791 Sep 01 08:34:24.105577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2085/4199] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:24 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:25.022908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:25.023552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:25.030910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:25.031384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:25.031811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:25.032496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:25.032933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:25.033347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:25.093157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:25.100642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d2a68d4-81f0-4db6-81db-a97d663317e7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081637 Sep 01 08:34:25.101186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2115/4200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:25 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:25.125369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:25.125983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:25.132138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:25.132619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:25.133053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:25.133751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:25.134204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:25.134652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:25.196385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:25.205453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-97df8c61-5b1c-4c62-9374-fb9e4cf48cd7 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083966 Sep 01 08:34:25.206023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2086/4201] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:25 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:26.121918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:26.123199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:26.129195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:26.129674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:26.130099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:26.130798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:26.131244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:26.131656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:26.194155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:26.202213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-32f6c085-290f-4467-9152-02ad77d94304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084130 Sep 01 08:34:26.202995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2116/4202] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:26 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:26.225988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:26.226623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:26.233314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:26.233791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:26.234218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:26.234935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:26.235407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:26.235796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:26.297208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:26.305041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-10d92a50-a3f4-4ba9-8ec7-1c7e551894b9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082875 Sep 01 08:34:26.305605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2087/4203] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:26 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:27.222119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:27.222752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:27.228674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:27.229153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:27.229583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:27.230320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:27.230768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:27.231186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:27.290101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:27.297683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5dab5e7-051b-4cd0-93db-5fe5cf37051f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.079385 Sep 01 08:34:27.298245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2117/4204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:27 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:27.325792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:27.327057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:27.333329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:27.333810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:27.334246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:27.334946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:27.335457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:27.335818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:27.396606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:27.404321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-089731ea-9ea8-47bb-a9e3-39ea8dbaaece tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082313 Sep 01 08:34:27.404890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2088/4205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:27 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:28.317878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:28.318507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:28.324330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:28.324806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:28.325236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:28.325908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:28.326403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:28.326821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:28.388733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:28.396358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9044ce5e-3ace-49fd-88ab-d1edbf49eeeb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.082316 Sep 01 08:34:28.396911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2118/4206] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:28 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:28.425263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:28.425811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:28.431674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:28.432146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:28.432578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:28.433255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:28.433685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:28.434097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:28.497330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:28.505792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f1da054f-1067-4e4b-9ba3-eeff1e0b7c56 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084312 Sep 01 08:34:28.506384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2089/4207] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:28 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:29.416793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:29.417393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:29.423526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:29.423997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:29.424423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:29.425103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:29.425546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:29.425964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:29.491359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:29.498845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0bd0150a-b926-4536-be31-73942e2a8f5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085846 Sep 01 08:34:29.499397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2119/4208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:29 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:29.526683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:29.527290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:29.533806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:29.534309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:29.534747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:29.535430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:29.535878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:29.536297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:29.596559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:29.604174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d677d2b7-17bd-4f95-a66e-03b13b68cc03 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081218 Sep 01 08:34:29.604754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2090/4209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:29 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:30.520281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:30.520911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:30.526900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:30.527375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:30.527806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:30.528483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:30.528930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:30.529962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:30.593450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:30.601274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d25fe505-8da1-42d7-a5d9-67e58d3e7118 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.084836 Sep 01 08:34:30.601847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2120/4210] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:30 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:30.624944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:30.625584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:30.631637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:30.632114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:30.632552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:30.633234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:30.633684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:30.634109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:30.843770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:30.851380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-71014506-3529-439a-8c5e-9c25cadea9d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.230324 Sep 01 08:34:30.851943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2091/4211] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:30 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:31.621548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:31.622180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:31.629028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:31.629509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:31.629943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:31.630655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:31.631106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:31.631525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:31.690898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:31.698426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-854a2f11-8089-4d11-afc1-7a748683685a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080649 Sep 01 08:34:31.698975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2121/4212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:31 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:31.873652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:31.874386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:31.880466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:31.880938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:31.881365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:31.882054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:31.882535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:31.882952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:31.944073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:31.952037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed3c2b18-7cf2-48d7-8096-eb7fef532951 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083125 Sep 01 08:34:31.952595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2092/4213] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:31 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:32.719870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:32.720475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:32.726476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:32.726886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:32.727306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:32.727972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:32.728411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:32.728823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:32.788270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:32.796427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0879aeb1-0194-4c3b-aa7f-807ea7e1b44c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080454 Sep 01 08:34:32.796982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2122/4214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:32 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:32.972978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:32.973580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:32.979803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:32.980210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:32.980638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:32.981362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:32.981810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:32.982807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:33.046382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:33.053935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b5fb921e-b092-4f7d-b6dd-8ece89f5ab42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084900 Sep 01 08:34:33.054524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2093/4215] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:32 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:33.816802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:33.817416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:33.823348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:33.823829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:33.824263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:33.824946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:33.825396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:33.825843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:33.886840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:33.894935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-51a8a9e3-77b2-45ae-b3af-193ee0f4969b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.081969 Sep 01 08:34:33.895491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2123/4216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:33 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:34.075432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:34.076083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:34.083494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:34.083978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:34.084416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:34.085105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:34.085559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:34.085979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:34.148143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:34.155598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2de1acb4-6e08-49a0-9d4f-28125d829c4d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084096 Sep 01 08:34:34.156133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2094/4217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:34 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:34.914618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:34.915222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:34.921085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:34.921557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:34.922104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:34.922920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:34.923370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:34.923897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:34.928097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:34.983937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:34.991614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f84f4f0b-2f88-48bc-8ddc-8561302cb181 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080910 Sep 01 08:34:34.992174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2124/4218] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:34 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:35.356244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:35.356855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:35.364599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:35.365133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:35.365567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:35.366279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:35.366737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:35.367158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:35.371273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:35.432380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:35.441277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91809f31-dd6c-4af7-b653-4e48625b5515 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.268765 Sep 01 08:34:35.441855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2095/4219] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:35 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:36.012925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:36.013534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:36.019920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:36.020406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:36.020835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:36.021527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:36.021974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:36.022422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:36.091743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:36.100381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9d454fd8-2390-4c4a-af5a-091ea3eea2c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.091832 Sep 01 08:34:36.101027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2125/4220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:36 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:36.463469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:36.464101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:36.471387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:36.471705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:36.472135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:36.472829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:36.473277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:36.473696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:36.542490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:36.549947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1fd9652f-927e-41e8-bdbe-304fbcb7eeed tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090235 Sep 01 08:34:36.550645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2096/4221] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:36 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:37.123340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:37.123948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:37.126659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=56 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:37.132144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:37.132625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:37.133056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:37.133744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:37.134189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:37.134632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:37.196709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:37.205242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7b3a226-8ea3-4939-9fdd-1e4f8ed9799a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.085732 Sep 01 08:34:37.205802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2126/4222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:37 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:37.574213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:37.575037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:37.581404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:37.581890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:37.582418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:37.583136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:37.583577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:37.584003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:37.647435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:37.655186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3ccbf063-8fca-4a5a-829b-22dfb7ed5089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084749 Sep 01 08:34:37.656391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2097/4223] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:37 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:38.226130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:38.226751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:38.232749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.233218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.233645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.234341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.234796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.235207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.295691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:38.303265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2f0e3e4-7eea-4a82-b509-f3167ef7aacb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 200 len: 1244 microversion: 2.1 time: 0.080978 Sep 01 08:34:38.303816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2127/4224] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:38 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:38.323828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:38.324313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:38.331318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.331800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.332233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.332918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.333364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.333812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.357471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:34:38.366337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.366811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.367243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.379977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'flavor' on Instance uuid 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:34:38.391394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'system_metadata' on Instance uuid 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:34:38.407307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'metadata' on Instance uuid 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:34:38.680197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:38.680909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:38.687644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.688262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.688790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.689726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.690008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.690467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.691752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Deleted allocations for instance 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 Sep 01 08:34:38.709548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-828e37ac-b905-4b2d-abfe-2482bd9f0e27 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 204 len: 0 microversion: 2.1 time: 0.389399 Sep 01 08:34:38.710412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2098/4225] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:34:38 2022] DELETE /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:34:38.717820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:38.719425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:38.725582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.726065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.726551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.727265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:38.727710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:38.728159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:38.743023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] HTTP exception thrown: Instance 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 could not be found. Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Request method failure captured: Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 HTTP/1.1 Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGvESDAEazsCEeCNcxG06A9K3it5r5eEzs0PvD93A7hjcqTHrlXbhK0f6m8Pd4m2YKHFzAfnzyGoSxRwwwSnsuTaLrGfBnNxX4I0AbMKiVHhtmL42A-Xvraj7YgIJiKoEJYG4Nr2y6nKk0P2U3418Jhl7f3hMOzSeqXyE6zXI_9tu5U Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: e8088d87969e46a2b2cc69dd7297ae14 Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:34:38.744499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e8088d87969e46a2b2cc69dd7297ae14", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: e8088d87969e46a2b2cc69dd7297ae14 Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-AttachVolumeNegativeTest-2002778612-project Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: ccd2c619e9fc436ea01a1200bc46b60f Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-AttachVolumeNegativeTest-2002778612-project Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 could not be found. Sep 01 08:34:38.746295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '7c1c34f2-0cf2-47d1-9421-97b45f33c3c0'} Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 could not be found. Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:34:38.747228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 could not be found. Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 could not be found. Sep 01 08:34:38.748879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:34:38.752321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Returning 404 to user: Instance 7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:34:38.752321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2c0fee2c-1fb6-40c9-8e9d-574b817581d0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0" status: 404 len: 111 microversion: 2.1 time: 0.031651 Sep 01 08:34:38.752321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2099/4226] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:38 2022] GET /compute/v2.1/servers/7c1c34f2-0cf2-47d1-9421-97b45f33c3c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 08:34:38.756100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d47b0db-f074-4b07-9df5-096b5448dc2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '.version_select at 0x7f2abf0b4dc0>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:38.756398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:38.764452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ececa1a-0ea9-4929-9523-5c2d805e5de1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090609 Sep 01 08:34:38.765390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2128/4227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:38 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:38.782451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d47b0db-f074-4b07-9df5-096b5448dc2f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-974400570" status: 202 len: 0 microversion: 2.1 time: 0.028797 Sep 01 08:34:38.783149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2100/4228] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Sep 1 08:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-974400570 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 08:34:39.493933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1fc21c2f-9169-4d7f-bf29-a1f0c049277a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Action: 'create', calling method: .version_select at 0x7f2ac29e7ee0>, body: {"keypair": {"name": "tempest-keypair-343239464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1mg5ZxNfgQW9P4SzAb8Chn93gGAmEwvC40QjIosYalFqx9ON8INFUx7TzIAn6JorRaIjHERgqdifNj3UiYVVxy5noEDY3ggn/cDeH/4ZRY5saYCgGYHAeG0KkYey4yBw=="}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:34:39.510693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-1fc21c2f-9169-4d7f-bf29-a1f0c049277a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:34:39.514300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-1fc21c2f-9169-4d7f-bf29-a1f0c049277a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for user ccd2c619e9fc436ea01a1200bc46b60f and project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:34:39.525684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1fc21c2f-9169-4d7f-bf29-a1f0c049277a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [477888b9-c9e8-4704-9e2d-259b4ada2d22] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 08:34:39.786832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:39.787437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:39.789226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:39.795757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:39.796248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:39.797377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:39.798248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:39.798701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:39.799130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:39.859572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:39.867800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ea4eda7c-3c39-434d-bf0b-7108115a665d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084839 Sep 01 08:34:39.868347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2101/4229] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:39 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:40.532749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [None req-1fc21c2f-9169-4d7f-bf29-a1f0c049277a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [477888b9-c9e8-4704-9e2d-259b4ada2d22] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54096. Sep 01 08:34:40.547869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1fc21c2f-9169-4d7f-bf29-a1f0c049277a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.056976 Sep 01 08:34:40.548671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2129/4230] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:34:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:34:40.888589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:40.889195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:40.895616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:40.896103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:40.896534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:40.897221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:40.897672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:40.898090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:40.962814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:40.971376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1277fed1-906e-4167-85eb-6f2866c1f302 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086682 Sep 01 08:34:40.971948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2102/4231] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:40 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:41.809105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1101050157", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fa62a9c-7a6e-4c3a-b7c4-bcbe5e7ff18a"}], "security_groups": [{"name": "tempest-securitygroup--1940069497"}], "key_name": "tempest-keypair-343239464", "user_data": "}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:34:41.916229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] validate_networks() for [('9fa62a9c-7a6e-4c3a-b7c4-bcbe5e7ff18a', None, None, None, None, None)] {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:34:41.992040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:41.992667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:41.998610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:41.999097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:41.999534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:42.000232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:42.000785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:42.001180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:42.066568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:42.074208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd75338f-7300-41b8-a3c6-fe64f3ea9933 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085926 Sep 01 08:34:42.074820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2103/4232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:41 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:42.423320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:34:42.423735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:34:42.424195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:34:42.424594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:34:42.424995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:34:42.433636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:42.434134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:42.434593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:42.435300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:42.435742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:42.436154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:42.452460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:34:42.456946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Getting quotas for user ccd2c619e9fc436ea01a1200bc46b60f and project e8088d87969e46a2b2cc69dd7297ae14. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:34:42.468016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:34:42.471058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:34:42.522444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1e54dd9-acf1-415d-90b8-a3b96b853cbe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717753 Sep 01 08:34:42.523148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2130/4233] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:34:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:34:42.534608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36eb0924-78d9-4220-bb9f-ea3857ddf048 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:42.535214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-36eb0924-78d9-4220-bb9f-ea3857ddf048 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:42.591557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-36eb0924-78d9-4220-bb9f-ea3857ddf048 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:42.599042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-36eb0924-78d9-4220-bb9f-ea3857ddf048 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1241 microversion: 2.1 time: 0.069035 Sep 01 08:34:42.599612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2104/4234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:42 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:43.096873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:43.097534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:43.106378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:43.107217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:43.108643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:43.109757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:43.113081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:43.113081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:43.187486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:43.196043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30026717-e531-4731-b4b1-7d7de93210a4 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.104195 Sep 01 08:34:43.196627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2131/4235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:43 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:43.620527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:43.621150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:43.627431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:43.627913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:43.628375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:43.629078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:43.629525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:43.629945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:43.694922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:43.702602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b0b3572a-1add-460b-99df-80a87dad9934 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085867 Sep 01 08:34:43.703435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2105/4236] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:43 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:44.216584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:44.217199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:44.223438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:44.223921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:44.224382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:44.225065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:44.225513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:44.225933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:44.285409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:44.293126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-60398c02-9e41-4bd7-9d04-f65033864c7e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080305 Sep 01 08:34:44.293695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2132/4237] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:44 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:44.723276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:44.723822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:44.730026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:44.730542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:44.730981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:44.731826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:44.732437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:44.732912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:44.794782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:44.803165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4257e033-5414-4eb5-a78b-6ede6bcab401 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083845 Sep 01 08:34:44.803719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2106/4238] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:44 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:45.313804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:45.314429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:45.320408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:45.320884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:45.321316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:45.321994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:45.322479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:45.322898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:45.383576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:45.391582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-12aaf193-f4ec-4896-a99a-3ffa4a09287c tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081457 Sep 01 08:34:45.392155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2133/4239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:45 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:45.826293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:45.826937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:45.833613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:45.834104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:45.834567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:45.835285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:45.835745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:45.836174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:45.905087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:45.913169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4afc6286-3d15-43d6-9f28-cbf07eceafbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.092220 Sep 01 08:34:45.913745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2107/4240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:45 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:46.412940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:46.413546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:46.419552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:46.420032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:46.420464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:46.421152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:46.421601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:46.422090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:46.486060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:46.493783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-802f2dd4-8901-4c38-b9e6-41b87b844c42 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084832 Sep 01 08:34:46.494366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2134/4241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:46 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:46.933599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:46.934236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:46.940912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:46.941393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:46.941860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:46.942580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:46.943031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:46.943451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:47.004923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:47.012455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-02f38a85-b050-48a6-81b7-df1fa826d3e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082671 Sep 01 08:34:47.013011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2108/4242] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:46 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:47.514763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:47.515394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:47.521243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:47.521710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:47.522134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:47.522825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:47.523267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:47.523678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:47.584514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:47.593168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c5aefa6-dd47-43cd-8db1-985ae3408213 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082084 Sep 01 08:34:47.594400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2135/4243] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:47 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:48.032940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:48.033543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:48.039941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:48.040422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:48.040860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:48.041560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:48.042015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:48.042468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:48.106340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:48.113958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c5bf1084-c9c8-4d9b-aeeb-15ccde085e8c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084944 Sep 01 08:34:48.114548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2109/4244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:48 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:48.615078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:48.615800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:48.622795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:48.623267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:48.623696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:48.624374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:48.624951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:48.625944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:48.685688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:48.694482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-39c1489a-3ebb-475f-9035-0e33e699114b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083148 Sep 01 08:34:48.695058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2136/4245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:48 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:49.135386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:49.135979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:49.143030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:49.143517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:49.143949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:49.144641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:49.145088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:49.145508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:49.161535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:49.209308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:49.216805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-acecd9c7-d4c2-490f-9962-002db8f45d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085250 Sep 01 08:34:49.217361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2110/4246] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:49 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:49.715957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:49.716563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:49.722517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:49.722941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:49.723366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:49.724036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:49.724478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:49.724891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:49.786394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:49.795292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db563164-52f2-4d68-ad3c-7207f069c95e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082967 Sep 01 08:34:49.795810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2137/4247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:49 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:50.238018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:50.238678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:50.245524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:50.245997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:50.246462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:50.247144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:50.247583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:50.247997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:50.311232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:50.319335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91f30c4c-ff9e-45ce-b997-ebbe18093335 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085931 Sep 01 08:34:50.319891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2111/4248] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:50 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:50.816956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:50.817629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:50.823729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:50.824237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:50.824675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:50.825365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:50.825809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:50.826222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:50.889104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:50.897558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7d1158cb-ddea-4414-a897-803afd4f4be8 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084369 Sep 01 08:34:50.898116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2138/4249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:50 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:51.339753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:51.340370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:51.346734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:51.347212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:51.347638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:51.348325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:51.348758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:51.349172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:51.409932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:51.417433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4de4480d-9a64-41ea-917b-b65afab5da3e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081586 Sep 01 08:34:51.417982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2112/4250] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:51 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:51.919593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:51.920210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:51.926777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:51.927250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:51.927679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:51.928352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:51.928793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:51.929211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:51.990217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:51.998067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16411711-2f99-4c38-8396-c719f3f26976 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082456 Sep 01 08:34:51.998594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2139/4251] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:51 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:52.439462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:52.440108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:52.446330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:52.446820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:52.447264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:52.447960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:52.448414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:52.448839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:52.513249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:52.521592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48cb767b-3f71-4825-bc9e-3e3a7cdf10a3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086762 Sep 01 08:34:52.522152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2113/4252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:52 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:53.019636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:53.020245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:53.022152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:53.022829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=10 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:53.028617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:53.029110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:53.029536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:53.030225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:53.030707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:53.031753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:53.092756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:53.101310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-519dbeeb-04b2-4c19-9ae9-16293875e508 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086197 Sep 01 08:34:53.101879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2140/4253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:53 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:53.541262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:53.541856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:53.543702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:53.550191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:53.550708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:53.551147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:53.551852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:53.552303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:53.552728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:53.619458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:53.628016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-347b340d-b976-4a73-8f2f-0ee49bfa4d07 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.090607 Sep 01 08:34:53.628588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2114/4254] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:53 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:54.122011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:54.122776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:54.130112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:54.130613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:54.131036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:54.131711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:54.132177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:54.132590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:54.199021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:54.208451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-abe9b519-ad2f-4b66-b6c8-02f6d7f9fc4a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090040 Sep 01 08:34:54.209025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2141/4255] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:54 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:54.647432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:54.648080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:54.654123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:54.654633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:54.655062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:54.655744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:54.656186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:54.657174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:54.725344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:54.732916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ecdeea33-97e7-4620-81c4-7c6d30935602 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.089320 Sep 01 08:34:54.733467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2115/4256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:54 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:55.228676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:55.229287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:55.235453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:55.235931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:55.236363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:55.237042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:55.237491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:55.237947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:55.256215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:55.298123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:55.305769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-57e02a72-4d92-4557-979e-1776851fa089 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080872 Sep 01 08:34:55.306484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2142/4257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:55 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:55.754400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:55.754972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:55.761166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:55.761640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:55.762066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:55.762777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:55.763217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:55.763630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:55.825315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:55.834133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b662bc1-4fc7-4daf-827e-988be4c0a5c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084095 Sep 01 08:34:55.834723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2116/4258] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:55 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:56.327848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:56.328484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:56.334752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:56.335226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:56.335654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:56.336330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:56.336776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:56.337192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:56.396250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:56.403980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-94d1bf01-a290-4680-abb7-7ee84e660a92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080223 Sep 01 08:34:56.404549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2143/4259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:56 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:56.854442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:56.855067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:56.861560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:56.862085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:56.862557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:56.863281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:56.863731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:56.864154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:56.928918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:56.936479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8cd52fa2-f1a3-4d90-8e3a-1cbc52a8a7ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085955 Sep 01 08:34:56.937042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2117/4260] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:56 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:57.425073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:57.425708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:57.431623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:57.432091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:57.432516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:57.433183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:57.433625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:57.434105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:57.494048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:57.511196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-62e86116-3868-4cac-b9d3-5b647852300d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090879 Sep 01 08:34:57.511773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2144/4261] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:57 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:57.958284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:57.958942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:57.965156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:57.965604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:57.966042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:57.966809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:57.967263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:57.967692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:58.029721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:58.041349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-573abc06-ea7a-46e3-9035-37a03b5f8aab tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.087179 Sep 01 08:34:58.042187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2118/4262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:57 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:58.531536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:58.532133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:58.538809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:58.539288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:58.539723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:58.540417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:58.540870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:58.541290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:58.603236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:58.611689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8e5b4dd5-b86d-486f-8797-1fafb7f3e43f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083843 Sep 01 08:34:58.612301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2145/4263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:58 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:34:59.066076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:59.066778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:59.073033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:59.073532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:59.073985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:59.074691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:59.075141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:59.075563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:59.139713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:59.147904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b73a3b0-32db-4ab3-8f71-d4e909acdc66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086674 Sep 01 08:34:59.148469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2119/4264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:59 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:34:59.632354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:34:59.632991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:34:59.638903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:59.639382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:59.639813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:59.640493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:34:59.640941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:34:59.641360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:34:59.702419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:34:59.710747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aa3e3430-7c78-41b8-ba0e-ee8f3288d156 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082114 Sep 01 08:34:59.711306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2146/4265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:34:59 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:00.168548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:00.169242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:00.175355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:00.175830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:00.176260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:00.176941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:00.177384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:00.177806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:00.238375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:00.246064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3a0edcb9-563d-44ba-b813-9becc1d1fd03 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081365 Sep 01 08:35:00.246663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2120/4266] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:00 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:00.731923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:00.732463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:00.739488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:00.740453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:00.740923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:00.741620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:00.742066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:00.742509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:00.806851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:00.815285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d141c863-86da-474a-b66e-eda8ee5d8adf tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.087081 Sep 01 08:35:00.815859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2147/4267] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:00 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:01.266584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:01.267252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:01.273711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:01.274198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:01.274661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:01.275358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:01.275806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:01.276226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:01.340473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:01.348387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dbf5d1de-df81-4a4f-8020-046b88b1d6e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085740 Sep 01 08:35:01.348937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2121/4268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:01 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:01.836887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:01.837500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:01.843435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:01.843912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:01.844340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:01.845008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:01.845606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:01.846027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:01.907222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:01.914900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-432ac80b-83d3-4722-aade-071f7f15b6a9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081986 Sep 01 08:35:01.915477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2148/4269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:01 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:02.369434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:02.370036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:02.376040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:02.377097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:02.377533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:02.378219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:02.378685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:02.379098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:02.439518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:02.447086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80c329ef-ebac-4978-8fbb-c87da4f0c8e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081414 Sep 01 08:35:02.447645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2122/4270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:02 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:02.936408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:02.937010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:02.943792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:02.944259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:02.944686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:02.945352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:02.945794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:02.946212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:03.007047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:03.014919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8ba281f0-9e5e-4080-a4dc-4448815a946f tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082278 Sep 01 08:35:03.015506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2149/4271] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:02 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:03.468411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:03.469046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:03.476472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:03.476960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:03.477393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:03.478155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:03.478633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:03.479055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:03.542094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:03.550202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d4faf50-30b7-487e-8f7a-96108aa97038 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085876 Sep 01 08:35:03.550784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2123/4272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:03 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:04.035793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:04.036420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:04.043183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:04.043658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:04.044085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:04.044788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:04.045230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:04.045646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:04.106583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:04.114450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-070fa1f9-9ed0-412c-8728-8d029c03397a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082381 Sep 01 08:35:04.115016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2150/4273] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:04 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:04.571109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:04.571882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:04.578381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:04.578865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:04.579298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:04.579995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:04.580444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:04.580864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:04.641603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:04.649519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b9e9fc36-7c65-4ef3-a880-a74604a62d7b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082324 Sep 01 08:35:04.650078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2124/4274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:04 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:05.135698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:05.136330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:05.142791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:05.143262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:05.143683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:05.144361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:05.144798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:05.145211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:05.206870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:05.216110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-90c0844a-9121-4995-be4f-faf32ab15e92 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084154 Sep 01 08:35:05.216741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2151/4275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:05 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:05.670461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:05.671067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:05.677174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:05.677651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:05.678082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:05.678791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:05.679234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:05.679646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:05.746196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:05.754762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-37d73bb3-47cc-4f96-981c-f2ee8997bd93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088083 Sep 01 08:35:05.755342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2125/4276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:05 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:06.238924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:06.239530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:06.245321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:06.245790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:06.246215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:06.246916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:06.247356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:06.247771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:06.307631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:06.315407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9a65fcf6-e53d-4ab5-901e-400908f1a091 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.080779 Sep 01 08:35:06.315966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2152/4277] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:06 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:06.776167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:06.776791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:06.783442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:06.783984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:06.784440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:06.785212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:06.785693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:06.786465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:06.849599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:06.857118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5718d78f-649f-432e-b5bc-5b9d5d281a91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084913 Sep 01 08:35:06.857665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2126/4278] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:06 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:07.336535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:07.337124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:07.338948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:07.345197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:07.345704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:07.346136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:07.346845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:07.347324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:07.347716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:07.407344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:07.415355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3103a993-9783-4879-ab4f-08d16b171733 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082564 Sep 01 08:35:07.415927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2153/4279] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:07 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:07.877978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:07.878916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:07.884677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:07.885151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:07.885577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:07.886277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:07.886721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:07.887136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:07.889734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:07.951525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:07.959939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd7a9bc1-1a2d-4d00-ad0b-fbd3ccb8ee99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086472 Sep 01 08:35:07.960492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2127/4280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:07 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:08.436970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:08.437570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:08.444543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:08.445024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:08.445458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:08.446147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:08.446632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:08.447058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:08.507145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:08.514748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-be2ba93d-ba41-4963-af04-9e9963243f49 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081636 Sep 01 08:35:08.515333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2154/4281] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:08 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:08.980734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:08.981336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:08.987672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:08.988152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:08.988583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:08.989274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:08.989718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:08.990135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:09.061763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:09.069407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-218f2831-b41e-4e87-8c40-e28060127300 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.092617 Sep 01 08:35:09.069966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2128/4282] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:08 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:09.535771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:09.538730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:09.549184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:09.549662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:09.550091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:09.550799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:09.551247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:09.551667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:09.611713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:09.619426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-32eae7c1-e807-4abb-b441-f69dfbeb1624 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.087829 Sep 01 08:35:09.620010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2155/4283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:09 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:10.093490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:10.094101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:10.096541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=58 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:10.101850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:10.102349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:10.102776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:10.103459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:10.103900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:10.104310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:10.171952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:10.180242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57303934-d9d9-4436-9b99-869ff0f4008d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.090595 Sep 01 08:35:10.180810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2129/4284] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:10 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:10.640498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:10.641318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:10.648225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:10.648710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:10.649144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:10.649840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:10.650312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:10.650740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:10.713632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:10.721956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-df8c7dc7-7019-4140-8fcb-31e93b8ad2e9 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085172 Sep 01 08:35:10.722605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2156/4285] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:10 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:11.201255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:11.201864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:11.208462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:11.208949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:11.209382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:11.210082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:11.210627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:11.211054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:11.273762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:11.281809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70f0e305-2e50-4937-a1a5-a5491f590d65 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084472 Sep 01 08:35:11.282390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2130/4286] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:11 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:11.743272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:11.743952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:11.749907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:11.750436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:11.750876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:11.751574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:11.752083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:11.752543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:11.813487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:11.821583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea4ec94d-4bd5-4c5c-8140-07fbfe9d6c9b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082128 Sep 01 08:35:11.822149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2157/4287] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:11 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:12.303425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:12.304031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:12.309988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:12.310510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:12.310982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:12.311809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:12.312249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:12.312659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:12.376887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:12.384427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-384ca322-9965-476d-81c4-726b6f405a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085407 Sep 01 08:35:12.384986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2131/4288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:12 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:12.842913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:12.843514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:12.850288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:12.850776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:12.851206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:12.851897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:12.852342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:12.852761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:12.912937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:12.920626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23afd836-dfc1-47a1-b2f3-84d70ddfd7d2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.081541 Sep 01 08:35:12.921205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2158/4289] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:12 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:13.405340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:13.405950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:13.413022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:13.413494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:13.413925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:13.414630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:13.415072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:13.415485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:13.478565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:13.486989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ddb0a49-277e-4191-b3dd-bc84a37bd315 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084776 Sep 01 08:35:13.487565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2132/4290] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:13 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:13.942569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:13.943197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:13.949375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:13.949849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:13.950309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:13.951001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:13.951466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:13.951859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:13.956245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:14.013397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:14.021462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4690929a-d35c-44db-a188-44299cf7411b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082974 Sep 01 08:35:14.022037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2159/4291] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:13 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:14.508160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:14.508800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:14.515002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:14.515481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:14.515905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:14.516593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:14.517037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:14.517515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:14.581312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:14.588880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-94fbcbd9-353d-45b2-8a01-65b27c9f0d16 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084836 Sep 01 08:35:14.589442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2133/4292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:14 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:15.042491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:15.043118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:15.049826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:15.050322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:15.050752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:15.051438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:15.051877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:15.052291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:15.113686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:15.121450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7e2c3f3-8b85-4a11-9bce-faa4c340194d tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082793 Sep 01 08:35:15.122010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2160/4293] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:15 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:15.609890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:15.610528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:15.617177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:15.617652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:15.618082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:15.618786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:15.619226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:15.619643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:15.681566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:15.689806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-456a6872-fa8b-4275-8d15-e743d4371d7f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083180 Sep 01 08:35:15.690530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2134/4294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:15 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:16.142640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:16.143328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:16.149170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:16.149642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:16.150070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:16.150773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:16.151620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:16.151620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:16.213197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:16.221873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7d219fe-6349-41b8-b9ff-3c47de78d34b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083120 Sep 01 08:35:16.222480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2161/4295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:16 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:16.711067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:16.711714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:16.717969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:16.718554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:16.718907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:16.719605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:16.720058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:16.721114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:16.785140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:16.792849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4e44530f-1cf8-4e09-a20b-ceffd718a73f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085640 Sep 01 08:35:16.793417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2135/4296] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:16 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:17.243383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:17.243971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:17.250130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:17.250643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:17.251080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:17.252400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:17.252968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:17.253387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:17.463861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:17.472448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8acd99ac-96b3-4446-be65-cf41164b7f66 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.232893 Sep 01 08:35:17.473036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2162/4297] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:17 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:17.813464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:17.814088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:17.820212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:17.820696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:17.821132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:17.821819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:17.822286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:17.822714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:17.886786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:17.894971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b669a430-5646-45ba-a557-13d4c6005c08 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085345 Sep 01 08:35:17.895531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2136/4298] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:17 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:18.493467 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:18.494071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:18.500245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:18.500717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:18.501138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:18.502422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:18.502867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:18.503283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:18.564995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:18.572820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2b85cbce-9fe6-44ef-be73-755916cb521e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083092 Sep 01 08:35:18.573400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2163/4299] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:18 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:18.915328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:18.915956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:18.921956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:18.922484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:18.922921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:18.924161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:18.924705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:18.925134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:18.985642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:18.994235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-799b2091-844c-4a6d-baec-79db3b153243 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082762 Sep 01 08:35:18.994839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2137/4300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:18 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:19.600972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:19.601607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:19.607913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:19.608427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:19.608859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:19.609600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:19.610055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:19.610509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:19.674421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:19.682163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-355b16f6-4e20-4a11-935e-793f526b0b28 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084988 Sep 01 08:35:19.682796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2164/4301] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:19 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:20.015208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:20.015799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:20.022871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:20.023354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:20.023785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:20.024470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:20.024916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:20.025335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:20.086468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:20.094080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dfcfa3b1-edd6-49b3-8932-cea6943c5e92 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082903 Sep 01 08:35:20.094667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2138/4302] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:20 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:20.702574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:20.703363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:20.710013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:20.710823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:20.711445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:20.712318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:20.712774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:20.713214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:20.785381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:20.800354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a53be57d-ddda-4237-87f9-a467342e6f09 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.101582 Sep 01 08:35:20.806298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2165/4303] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:20 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:21.115393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:21.116005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:21.121964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:21.122496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:21.122942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:21.123628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:21.124080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:21.124497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:21.185484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:21.193677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-622ee237-f458-4ff0-9dd0-1d45339ef4a5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083040 Sep 01 08:35:21.194242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2139/4304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:21 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:21.822310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:21.822964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:21.830133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:21.830654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:21.831082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:21.831801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:21.832250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:21.832932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:21.903515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:21.912308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1b3c533-908e-40b7-bd88-9c0a825ca999 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.093976 Sep 01 08:35:21.912905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2166/4305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:21 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:22.214247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:22.214883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:22.221549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:22.222020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:22.222485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:22.223174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:22.223618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:22.224046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:22.285930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:22.293445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be150965-380f-4155-9526-483073bcf781 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083029 Sep 01 08:35:22.294015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2140/4306] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:22 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:22.932978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:22.933605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:22.940486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:22.940965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:22.941393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:22.942083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:22.942569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:22.942987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:23.006577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:23.014455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a2fea94a-0138-4ede-bac2-199bcce0fc3b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085182 Sep 01 08:35:23.015244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2167/4307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:22 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:23.314867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:23.315529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:23.321568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:23.322045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:23.322501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:23.323191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:23.323639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:23.324056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:23.384950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:23.392946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-73fa9d73-2b67-4f77-8357-e6375e486706 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082048 Sep 01 08:35:23.393667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2141/4308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:23 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:24.035252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:24.035871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:24.041800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:24.042299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:24.042739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:24.043453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:24.043898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:24.044314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:24.110004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:24.118349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae12e3c5-0bfb-44cb-ae16-8f99f9d1d013 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086748 Sep 01 08:35:24.118917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2168/4309] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:24 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:24.413905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:24.414513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:24.420499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:24.420980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:24.421419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:24.422106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:24.422589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:24.423012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:24.484507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:24.494044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7cb61c41-8ede-44c2-855e-6060986c3697 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083867 Sep 01 08:35:24.494647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2142/4310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:24 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:25.139502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:25.140135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:25.146540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:25.147021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:25.147455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:25.148221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:25.149267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:25.149738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:25.211788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:25.219890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-62d69c68-5abd-4c16-b28d-4fdebab50833 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084118 Sep 01 08:35:25.220507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2169/4311] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:25 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:25.516603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:25.517253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:25.523639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:25.524118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:25.524542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:25.525227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:25.525669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:25.526085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:25.588896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:25.591130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:25.597752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d193393a-3d9e-4e0b-bff1-e57a53934cf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084950 Sep 01 08:35:25.598324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2143/4312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:25 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:26.240617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:26.241253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:26.247184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:26.247663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:26.248087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:26.248768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:26.249214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:26.249630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:26.314351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:26.322107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-075248f2-3141-48a2-92b9-c56651f11948 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085246 Sep 01 08:35:26.322715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2170/4313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:26 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:26.618291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:26.618903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:26.624984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:26.625524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:26.625961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:26.627249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:26.627791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:26.628215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:26.690336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:26.697812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-173047e8-9b86-41c7-abc0-f69dfbc094c1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083418 Sep 01 08:35:26.698391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2144/4314] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:26 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:27.344279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:27.344895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:27.351469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:27.351947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:27.352382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:27.353073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:27.353520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:27.353939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:27.416586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:27.425453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-30eef74c-194c-4bf4-8660-964f13e6867e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084877 Sep 01 08:35:27.426036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2171/4315] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:27 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:27.719219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:27.719833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:27.726831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:27.727314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:27.727745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:27.728435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:27.728882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:27.729301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:27.789321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:27.796880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-170d6e52-19a1-44ce-ba0d-6c124b9c18ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081614 Sep 01 08:35:27.797443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2145/4316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:27 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:28.446800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:28.447388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:28.453645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:28.454127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:28.454668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:28.455447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:28.455921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:28.456339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:28.521121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:28.529808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d117e52a-7ed2-4621-8cb2-63a333e0939a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086725 Sep 01 08:35:28.530549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2172/4317] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:28 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:28.817006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:28.817603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:28.823780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:28.824266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:28.824703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:28.825403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:28.825853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:28.826296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:28.888298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:28.898415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b7ba4dd-87d6-40f3-aaad-ea30d71ea68a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085230 Sep 01 08:35:28.898997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2146/4318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:28 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:29.551219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:29.551827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:29.557770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:29.558242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:29.558699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:29.559373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:29.559819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:29.560237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:29.622098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:29.630472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b8ea90f2-dccb-4c72-a8c2-5cf98585133a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083263 Sep 01 08:35:29.631065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2173/4319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:29 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:29.919095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:29.919703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:29.926352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:29.926839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:29.927274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:29.927967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:29.928415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:29.928833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:29.990619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:29.998028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-010a05cf-7ae8-46b6-88cb-a6bced859f10 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082789 Sep 01 08:35:29.998611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2147/4320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:29 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:30.651710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:30.652303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:30.658497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:30.658975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:30.659409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:30.660089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:30.660535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:30.660955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:30.723696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:30.731425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-08a67439-cf20-4e73-b032-26fd77edf53e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083530 Sep 01 08:35:30.731989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2174/4321] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:30 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:31.019191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:31.019775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:31.026251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:31.026767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:31.027216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:31.027887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:31.028392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:31.028816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:31.092358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:31.101067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57a4ef69-62fb-400e-9db8-b6fdbae94e61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086127 Sep 01 08:35:31.101649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2148/4322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:31 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:31.753534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:31.754106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:31.760203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:31.760691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:31.761124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:31.761824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:31.762298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:31.762727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:31.825813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:31.829484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:31.834547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-57f148e6-fbba-4e77-888f-ec132b614fa3 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085523 Sep 01 08:35:31.835128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2175/4323] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:31 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:32.122511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:32.123109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:32.129669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:32.130143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:32.130599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:32.131286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:32.131722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:32.132137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:32.192189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:32.200084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4ee31359-9891-4d35-8177-451e6f8c9fdf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081315 Sep 01 08:35:32.200659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2149/4324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:32 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:32.856045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:32.856660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:32.864134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:32.864610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:32.865034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:32.865714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:32.866150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:32.866596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:32.933121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:32.941613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ab5acda-605e-4cdc-8cfc-0c5ec2a9d72e tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.089513 Sep 01 08:35:32.942183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2176/4325] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:32 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:33.222027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:33.222720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:33.228538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:33.229012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:33.229442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:33.230124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:33.230594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:33.231012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:33.291826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:33.300121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f12b22b6-7429-4cfc-acf5-ed8a3cea535b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082472 Sep 01 08:35:33.300720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2150/4326] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:33 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:33.964308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:33.965032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:33.971918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:33.972387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:33.972808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:33.973648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:33.974092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:33.974709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:34.037956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:34.046161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25a9601d-fb65-427c-b9fd-cbe4e66cdc0a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086818 Sep 01 08:35:34.046812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2177/4327] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:33 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:34.320960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:34.321549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:34.327886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:34.328360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:34.328790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:34.329467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:34.330621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:34.330981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:34.389932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:34.397567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-642081bb-a81e-47a7-ad38-e25f2cc1bd90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080475 Sep 01 08:35:34.398126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2151/4328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:34 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:35.068068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:35.068754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:35.074646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:35.075123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:35.075550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:35.076227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:35.076673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:35.077357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:35.142199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:35.150600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-707a4ada-8529-45d3-bdb7-2bc965510739 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.086361 Sep 01 08:35:35.151177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2178/4329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:35 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:35.418457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:35.419025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:35.425006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:35.425481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:35.425912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:35.426618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:35.427071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:35.427490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:35.489169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:35.496885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d9eb9bb8-dcdf-45bc-b6f4-412df5d97b51 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082415 Sep 01 08:35:35.497628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2152/4330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:35 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:36.174433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:36.175276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:36.181637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:36.182116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:36.182586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:36.183347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:36.184107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:36.184842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:36.256862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:36.264956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-08bdbdba-3c04-480c-aaa5-6315ac6af672 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.096055 Sep 01 08:35:36.266201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2179/4331] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:36 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:36.518378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:36.519224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:36.528735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:36.529520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:36.530355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:36.531550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:36.532295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:36.532806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:36.601339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:36.609574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-05d6b5a6-49c6-4e87-b32a-76f8e6a61067 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.095317 Sep 01 08:35:36.610338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2153/4332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:36 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:37.287920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:37.288530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:37.294518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:37.294992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:37.295419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:37.296095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:37.296542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:37.296969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:37.359800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:37.368054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-adeb6d65-efc1-4ca0-b781-43b04d6cdc41 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.083900 Sep 01 08:35:37.368625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2180/4333] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:37 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:37.635911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:37.636474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:37.642404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:37.642879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:37.643309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:37.643977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:37.644421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:37.644837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:37.706604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:37.714425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5ecf2c9f-0175-4471-b2b5-965e00530544 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082311 Sep 01 08:35:37.714987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2154/4334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:37 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:38.388862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:38.389468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:38.391312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=56 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:38.397080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:38.397547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:38.397971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:38.398668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:38.399108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:38.399520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:38.459819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:38.467672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1dd9356-789e-4b52-8265-a67b9a30725a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.082555 Sep 01 08:35:38.468250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2181/4335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:38 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:38.735871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:38.737068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:38.742998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:38.743480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:38.743903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:38.744569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:38.745016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:38.745431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:38.804668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:38.812173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-20fcaa63-4b10-4cfc-b38c-6176b7a2f76d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080127 Sep 01 08:35:38.812741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2155/4336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:38 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:39.489103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:39.489744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:39.495724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:39.496204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:39.496637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:39.497315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:39.497777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:39.498227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:39.562435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:39.570632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e0de7eff-57e7-4575-a8e6-645999c7cc85 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085338 Sep 01 08:35:39.571325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2182/4337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:39 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:39.833517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:39.834114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:39.840170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:39.840638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:39.841063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:39.841728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:39.842168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:39.842611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:39.902042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:39.910966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4a59034b-4dc9-4baf-bc73-c527bbb80747 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081667 Sep 01 08:35:39.911537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2156/4338] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:39 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:40.594738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:40.595421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:40.602003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:40.602517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:40.602947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:40.603654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:40.604074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:40.604490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:40.666939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:40.675513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bc05c340-bfcd-4c9a-bf55-dbefa037a3ef tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.084919 Sep 01 08:35:40.676095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2183/4339] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:40 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:40.932056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:40.932658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:40.934568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=56 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:40.940800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:40.941284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:40.941737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:40.942462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:40.942905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:40.943575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:41.014250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:41.022640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d77bd792-4e72-441c-b210-ec0ddc55b21d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.094573 Sep 01 08:35:41.023206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2157/4340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:40 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:41.696066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:41.696678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:41.702918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:41.703393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:41.703824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:41.704513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:41.704968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:41.705369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:41.769412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:41.777441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1a328ff0-adf7-47fb-91cc-aebb7dfa3b2a tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085087 Sep 01 08:35:41.778495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2184/4341] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:41 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:42.044706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:42.045353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:42.052015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:42.052510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:42.052919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:42.053599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:42.054042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:42.054498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:42.115779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:42.123508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-392e9d16-264d-47c2-9f7d-bb39a6730dcf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082658 Sep 01 08:35:42.124076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2158/4342] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:42 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:42.801213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:42.802246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:42.809473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:42.809976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:42.810460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:42.811197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:42.811652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:42.812076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:42.879389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:42.887785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a016bce-d95d-4676-b529-ad946b429041 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.092126 Sep 01 08:35:42.888365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2185/4343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:42 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:43.144790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:43.145406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:43.151423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:43.151900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:43.152327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:43.153015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:43.153465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:43.153881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:43.216807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:43.225298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ae99fc9e-0ce7-482b-81c0-72d80521db50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085021 Sep 01 08:35:43.225877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2159/4344] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:43 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:43.908967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:43.909569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:43.916765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:43.917247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:43.917725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:43.918407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:43.918851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:43.919270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:43.987229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:43.996082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ab99095-6a55-4add-a933-673192b44cf2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090852 Sep 01 08:35:43.996678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2186/4345] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:43 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:44.246705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:44.247273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:44.258194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:44.258732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:44.259156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:44.259841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:44.260281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:44.260693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:44.276805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=100 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:44.323127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:44.331677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-16a4d6ab-f794-4a9b-b3a5-708a5d2a98ee tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088394 Sep 01 08:35:44.332269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2160/4346] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:44 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:45.018133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:45.019022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:45.025095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:45.025581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:45.026009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:45.026744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:45.027195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:45.027617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:45.093102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:45.099944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-547fcbc8-5a18-40d1-9d7b-7146541a4913 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.085786 Sep 01 08:35:45.100514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2187/4347] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:45 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:45.353085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:45.353716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:45.359733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:45.360256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:45.360688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:45.361371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:45.361818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:45.362237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:45.426513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:45.434242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a2b74b04-2d85-45dc-b82a-b5fbf7b6a561 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085138 Sep 01 08:35:45.434839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2161/4348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:45 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:46.120966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:46.121624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:46.127680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.128711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.129289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.129972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.130445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.130867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.193876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f56c04652d4406a8af97bd4b0268bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7a479aae1144f289a9c79417c064b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:46.207482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-66c3453e-deef-43e1-ba6f-fdf16648d356 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 200 len: 1262 microversion: 2.1 time: 0.090199 Sep 01 08:35:46.208061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2188/4349] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:46 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:46.233292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:46.233810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:46.241024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.241593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.242066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.242885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.243364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.243789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.270830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:35:46.281568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.282042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.282516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.298310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lazy-loading 'flavor' on Instance uuid 05294080-db18-44ab-8700-69fa11d567c2 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:35:46.311167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lazy-loading 'system_metadata' on Instance uuid 05294080-db18-44ab-8700-69fa11d567c2 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:35:46.327716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lazy-loading 'metadata' on Instance uuid 05294080-db18-44ab-8700-69fa11d567c2 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:35:46.461226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:46.462314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:46.470603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.471221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.472435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.473910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.475074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.475704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.482030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Deleted allocations for instance 05294080-db18-44ab-8700-69fa11d567c2 Sep 01 08:35:46.502453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-419681f4-e5f3-41f2-b221-643d99b84d6b tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 204 len: 0 microversion: 2.1 time: 0.272941 Sep 01 08:35:46.503150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2162/4350] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:35:46 2022] DELETE /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:35:46.513219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:46.513878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] [instance: 05294080-db18-44ab-8700-69fa11d567c2] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:46.522827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.523314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.523751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.524455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:46.524906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:46.525325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:46.541488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] HTTP exception thrown: Instance 05294080-db18-44ab-8700-69fa11d567c2 could not be found. Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Request method failure captured: Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 HTTP/1.1 Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEG1mDS7QSxvNANMLOq0IyYu86woD7td5OXK-ronQuOukEuu7nSh0bRD9gyvaWsO8Vkii4DbC3WMw0vK88NG9yqt9W5tmLw7F0Zrb4yCh4qDLmdkFTwlNndrd65d2s3GgKugDCptNPT2kcdqNF833HIe6AzjjzvHlWga-K9_ubXciA-g Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: 5d7a479aae1144f289a9c79417c064b4 Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-TestMinimumBasicScenario-95611782 Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:35:46.543064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d7a479aae1144f289a9c79417c064b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d7a479aae1144f289a9c79417c064b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d7a479aae1144f289a9c79417c064b4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d7a479aae1144f289a9c79417c064b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-TestMinimumBasicScenario-95611782 Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: 5d7a479aae1144f289a9c79417c064b4 Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-TestMinimumBasicScenario-95611782 Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-TestMinimumBasicScenario-95611782-project Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: 6f56c04652d4406a8af97bd4b0268bc6 Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-TestMinimumBasicScenario-95611782-project Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance 05294080-db18-44ab-8700-69fa11d567c2 could not be found. Sep 01 08:35:46.550028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '05294080-db18-44ab-8700-69fa11d567c2'} Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05294080-db18-44ab-8700-69fa11d567c2 could not be found. Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:35:46.551190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05294080-db18-44ab-8700-69fa11d567c2 could not be found. Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05294080-db18-44ab-8700-69fa11d567c2 could not be found. Sep 01 08:35:46.552924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:35:46.554591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Returning 404 to user: Instance 05294080-db18-44ab-8700-69fa11d567c2 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:35:46.554591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9bdf725e-b573-4d96-afe6-b54038aad5d1 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2" status: 404 len: 111 microversion: 2.1 time: 0.036231 Sep 01 08:35:46.554591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2163/4351] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:46 2022] GET /compute/v2.1/servers/05294080-db18-44ab-8700-69fa11d567c2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:35:46.556271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9682adde-2038-46a7-a266-df9083003ed2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] Calling method '.version_select at 0x7f2ac29c1a60>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:46.565603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:46.578936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9e633494-df2f-41ae-86b0-972c1f911643 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.125157 Sep 01 08:35:46.582342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2189/4352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:46 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:46.595615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9682adde-2038-46a7-a266-df9083003ed2 tempest-TestMinimumBasicScenario-95611782 tempest-TestMinimumBasicScenario-95611782-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-111356440" status: 202 len: 0 microversion: 2.1 time: 0.043255 Sep 01 08:35:46.596653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2164/4353] 10.222.0.43 () {58 vars in 1269 bytes} [Thu Sep 1 08:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-111356440 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 08:35:47.603068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:47.604060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:47.613942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:47.614553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:47.615020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:47.615732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:47.616206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:47.616622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:47.685801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:47.697479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e42b42fc-0a81-40c2-b999-db9cc9e678c4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.098290 Sep 01 08:35:47.698085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2190/4354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:47 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:48.723619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:48.724763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:48.735504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:48.736723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:48.738229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:48.739719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:48.740563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:48.741345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:48.890156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:48.898758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-af2062a5-bd4d-4819-b9c3-8c45cc0e0180 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.183212 Sep 01 08:35:48.899451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2165/4355] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:48 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:49.919039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:49.919719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:49.927000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:49.927522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:49.928050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:49.928823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:49.929561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:49.929900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:50.067772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:50.077682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ef6e84ac-8058-4162-bf31-80f586b1a162 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.161785 Sep 01 08:35:50.078472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2191/4356] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:49 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:51.105090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:51.105690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:51.111834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:51.112370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:51.112954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:51.113641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:51.114087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:51.117132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:51.199420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:51.207847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-76c0b858-af3b-4f7f-bb96-026ca32e6bd7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.108112 Sep 01 08:35:51.208412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2166/4357] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:51 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:52.229054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:52.229640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:52.235905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:52.236385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:52.236816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:52.238172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:52.238692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:52.239111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:52.259014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=100 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:52.424532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:52.432925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b164871-b0fe-4d34-9328-b911b5a76e6b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.207756 Sep 01 08:35:52.433513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2192/4358] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:52 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:53.459243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:53.460156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:53.473695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:53.473695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:53.474576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:53.475411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:53.476013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:53.476611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:53.549060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:53.557772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e068842-9c0d-4faf-acdf-232ab8bbc00a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.106502 Sep 01 08:35:53.558361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2167/4359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:53 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:54.579463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:54.580165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:54.587376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:54.587872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:54.588305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:54.589024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:54.589476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:54.589896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:54.665214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:54.678324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-65d5fe4a-0e07-493a-a800-97b72fe12c8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.102966 Sep 01 08:35:54.679414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2193/4360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:54 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:55.699839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:55.700956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:55.710557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:55.711040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:55.711520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:55.712291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:55.712764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:55.713198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:55.785596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:55.795554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-697a9355-8d3a-4925-8679-4069ce35f0a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.099773 Sep 01 08:35:55.796163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2168/4361] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:55 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:56.820402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:56.821026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:56.829084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:56.829575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:56.830011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:56.831314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:56.831764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:56.832340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:56.899930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:56.908126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03f845fd-e63c-414f-a7f2-dff34ca37665 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.091646 Sep 01 08:35:56.908711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2194/4362] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:56 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:35:57.931701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:57.932360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:57.938836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:57.939328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:57.939766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:57.941243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:57.942018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:57.942685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:58.013066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:58.026963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-36b27bf7-4845-4b12-acb8-4c4da9b7c179 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.098755 Sep 01 08:35:58.028340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2169/4363] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:57 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:35:59.048549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:35:59.049224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:35:59.059976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:59.060460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:59.060894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:59.061625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:35:59.062066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:35:59.062511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:35:59.126623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:35:59.134850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c72e94df-2010-4ec5-a000-6dcbb2af3ac3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.090042 Sep 01 08:35:59.135436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2195/4364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:35:59 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:00.156478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:00.157210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:00.163655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:00.164136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:00.164568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:00.165273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:00.165717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:00.166137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:00.237393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:00.245622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c324fa3b-269a-47e4-8033-6d31ae53f18a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.093023 Sep 01 08:36:00.246202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2170/4365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:00 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:36:01.267865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:01.269258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:01.276491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:01.276980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:01.277422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:01.278279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:01.278741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:01.279341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:01.347057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:01.359716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0005535b-f005-4603-baa0-da9faeedc87d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.095422 Sep 01 08:36:01.360587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2196/4366] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:01 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:02.393571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:02.394372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:02.400493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:02.400969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:02.401397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:02.402083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:02.402561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:02.402976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:02.474748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:02.482887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bc3d10d9-ff1a-4bab-b26b-bd1f12a9fd69 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.093787 Sep 01 08:36:02.483467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2171/4367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:02 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:03.507160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:03.507882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:03.514166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:03.514685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:03.515117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:03.515816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:03.516266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:03.516678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:03.579873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:03.588720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e48efa1-7be3-4081-9917-bfbdee406dcd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.087804 Sep 01 08:36:03.589448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2197/4368] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:03 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:04.611411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:04.612044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:04.618622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:04.619112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:04.619546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:04.620251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:04.620698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:04.621121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:04.684470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:04.692436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-21b6e611-406c-4d53-ac2f-06f96464f470 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085135 Sep 01 08:36:04.692945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2172/4369] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:04 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:05.712811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:05.713398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:05.719240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:05.719708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:05.720132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:05.720800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:05.721781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:05.722352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:05.787304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:05.795070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a00d4e9a-7e1c-4aa4-afdb-6d321cfa4082 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085955 Sep 01 08:36:05.795649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2198/4370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:05 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:06.817264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:06.817896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:06.823968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:06.824450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:06.824885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:06.825592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:06.826037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:06.826753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:06.893929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:06.902228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d1cea53-2bb9-4ad9-8d1a-e71cd5e2200a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.089588 Sep 01 08:36:06.902839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2173/4371] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:06 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:07.922994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:07.923644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:07.931049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:07.931533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:07.931966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:07.932661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:07.933108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:07.933527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:07.995883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:08.004435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bd055eae-d3db-48fe-845a-4ca74b80e26d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085190 Sep 01 08:36:08.005006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2199/4372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:07 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:09.025126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:09.025701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:09.032050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:09.032535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:09.032978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:09.033740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:09.034203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:09.034855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:09.054507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:09.101699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:09.109318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fcb187f9-9c91-4dfd-8313-78da3472ff93 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088069 Sep 01 08:36:09.109870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2174/4373] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:09 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:36:10.131436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:10.132055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:10.133847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=38 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:10.138948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:10.139427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:10.139858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:10.140546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:10.140997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:10.141416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:10.214393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:10.222032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c72ca652-1487-4171-9da2-f3fc625a9123 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.094936 Sep 01 08:36:10.222627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2200/4374] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:10 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:11.242740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:11.243484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:11.245649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:11.252813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:11.253453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:11.253973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:11.254792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:11.255248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:11.255764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:11.331435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:11.339389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad2d0059-d72f-47c6-a1ab-7f14fceb2d34 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.100392 Sep 01 08:36:11.339957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2175/4375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:11 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:12.361183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:12.361794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:12.367731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:12.368206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:12.368643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:12.369347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:12.369797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:12.370217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:12.432323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:12.440536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5a2a4b2b-e655-4bc3-add2-377d51a3322d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082585 Sep 01 08:36:12.441298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2201/4376] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:12 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:13.461456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:13.462080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:13.468002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:13.468478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:13.468902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:13.469574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:13.470019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:13.470552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:13.533158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:13.541672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e780069d-7f04-4d45-9223-c27861c529af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084009 Sep 01 08:36:13.542236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2176/4377] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:13 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:14.562085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:14.562752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:14.568797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:14.569274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:14.569707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:14.570410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:14.570860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:14.571279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:14.631595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:14.639227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db6b88f7-ecda-4e9b-b930-498236b5f0a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080927 Sep 01 08:36:14.639784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2202/4378] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:14 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:15.661292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:15.662132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:15.663920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:36:15.664071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 (ip 10.222.0.43) !!! Sep 01 08:36:15.672064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:15.672545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:15.672976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:15.673663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:15.674625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:15.675291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:15.741918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:15.749582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9e6283bd-83c4-4c52-98a6-5fe28d2b9957 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.094114 Sep 01 08:36:15.750146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2177/4379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:15 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:16.770548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:16.771151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:16.777292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:16.777758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:16.778180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:16.778871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:16.779312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:16.779729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:16.839938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:16.848195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0321f17a-0468-4101-baa6-89ae0ddac79a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081627 Sep 01 08:36:16.848763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2203/4380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:16 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:17.867751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:17.868358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:17.874382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:17.874863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:17.875299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:17.875975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:17.876423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:17.876844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:17.937258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:17.945268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6671c208-bd04-43a4-a8c9-b3f8bc9d81a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081292 Sep 01 08:36:17.945831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2178/4381] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:17 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:18.965601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:18.966196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:18.972759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:18.973228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:18.973651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:18.974349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:18.974793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:18.975205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:19.034335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:19.041792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e47202ec-1643-415b-903e-ff4f838ed1a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080027 Sep 01 08:36:19.042357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2204/4382] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:18 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:20.061688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:20.062331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:20.069144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:20.069612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:20.070043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:20.070736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:20.071177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:20.071594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:20.134984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:20.142593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-30e6f0d7-782d-4dcf-be3d-24609fc62b90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084636 Sep 01 08:36:20.143197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2179/4383] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:20 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:21.166188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:21.166849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:21.172924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:21.173491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:21.173929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:21.174884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:21.175392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:21.175818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:21.382678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:21.390403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fcbc9b85-599b-4712-9a10-e701821d8ddb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.228038 Sep 01 08:36:21.390965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2205/4384] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:21 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:36:22.412346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:22.412889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:22.418738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:22.419214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:22.419643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:22.420320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:22.420786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:22.421180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:22.481466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:22.489242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-480c186b-bc34-4819-8bcd-b9c5331cc6ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081394 Sep 01 08:36:22.489796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2180/4385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:22 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:23.509725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:23.510346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:23.516602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:23.517066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:23.517664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:23.518387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:23.518832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:23.519250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:23.521834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=81 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:23.580726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:23.588397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24a68e38-2152-428d-8c4d-5051bcdd563f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082545 Sep 01 08:36:23.588978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2206/4386] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:23 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:24.609154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:24.609745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:24.616124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:24.616599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:24.617031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:24.617706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:24.618153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:24.618703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:24.682051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:24.690124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5c97aac3-4861-4c52-bf42-f2ad1606ac5e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084383 Sep 01 08:36:24.690714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2181/4387] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:24 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:25.711228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:25.711822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:25.718373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:25.718846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:25.719286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:25.720146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:25.720623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:25.721663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:25.784118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:25.792170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c85fa6e-a876-4eb9-a489-89ff918736fe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085003 Sep 01 08:36:25.792713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2207/4388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:25 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:26.812777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:26.813375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:26.819802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:26.820275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:26.820703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:26.821376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:26.821820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:26.822235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:26.882650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:26.890074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-de6b11df-d725-4729-85c6-aefcbf8e7f02 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081072 Sep 01 08:36:26.890658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2182/4389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:26 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:27.911520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:27.912137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:27.917961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:27.918469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:27.918902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:27.919572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:27.920014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:27.920426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:27.979624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:27.987230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-896b45bc-f2e1-4604-88bf-b03bdc60442d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080104 Sep 01 08:36:27.987861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2208/4390] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:27 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:29.008727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:29.009643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:29.016005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:29.016476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:29.016904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:29.017579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:29.018021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:29.020193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:29.081526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:29.089076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-55138db8-433a-4be2-b301-520a0ba84594 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084405 Sep 01 08:36:29.089635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2183/4391] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:29 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:30.109626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:30.110289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:30.116468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:30.116971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:30.117402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:30.118080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:30.118559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:30.118978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:30.184496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:30.192741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-16d33289-6916-4df0-8478-37b4d0561dc2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086969 Sep 01 08:36:30.193298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2209/4392] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:30 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:31.213430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:31.214022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:31.220326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:31.220812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:31.221783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:31.222555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:31.223005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:31.223432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:31.282453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:31.290528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0672eef6-b735-432e-b3a0-706abd954139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081434 Sep 01 08:36:31.291086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2184/4393] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:31 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:32.311837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:32.312529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:32.318374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:32.318847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:32.319275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:32.319945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:32.320387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:32.320799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:32.379966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:32.387495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cfad9e57-a81f-4e9f-9102-26a15642d649 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079529 Sep 01 08:36:32.388055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2210/4394] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:32 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:33.408679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:33.409455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:33.415448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:33.415927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:33.416356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:33.417040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:33.417486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:33.417906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:33.480284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:33.487901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-83668498-0361-4efc-9319-ba33cb276d00 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082985 Sep 01 08:36:33.488461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2185/4395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:33 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:34.508719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:34.509319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:34.515149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:34.515624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:34.516052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:34.516723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:34.517159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:34.517572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:34.579817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:34.587525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bc833f3b-4151-4305-89fa-0a05a663a900 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082625 Sep 01 08:36:34.588077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2211/4396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:34 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:35.608726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:35.609375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:35.615842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:35.616316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:35.616743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:35.617419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:35.617856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:35.618278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:35.677765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:35.685311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ea2ac78c-dba5-450d-94d5-dde90cb53355 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080405 Sep 01 08:36:35.685878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2186/4397] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:35 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:36.705112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:36.705725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:36.711673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:36.712154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:36.712587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:36.713261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:36.713705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:36.714129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:36.774585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:36.782199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ab5c82d8-465c-4a0e-b904-9b94fa8e144d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081160 Sep 01 08:36:36.782789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2212/4398] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:36 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:37.803092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:37.803693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:37.809720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:37.810198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:37.810665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:37.811347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:37.811816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:37.812456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:37.874154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:37.883190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-60a093a0-c463-487a-80af-da2fce1b7cbd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083466 Sep 01 08:36:37.883190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2187/4399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:37 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:38.903326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:38.903930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:38.910060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:38.910563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:38.910995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:38.911672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:38.912118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:38.912535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:38.976079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:38.983579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2535c867-17ef-424c-9687-82a20e6cc387 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084084 Sep 01 08:36:38.984132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2213/4400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:38 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:40.005341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:40.005889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:40.011853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:40.012319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:40.012742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:40.016536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:40.017020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:40.017450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:40.020752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=81 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:40.084283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:40.091986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4c5df2d4-f903-4d9f-833f-c7837cbe9c78 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.091266 Sep 01 08:36:40.092540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2188/4401] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:39 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:41.112978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:41.113584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:41.115545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:41.120628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:41.121099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:41.121525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:41.122194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:41.122669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:41.123085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:41.184682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:41.193128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b4e64752-66d1-49c8-aa88-49d28e1a99c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084536 Sep 01 08:36:41.193691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2214/4402] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:41 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:42.214155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:42.214798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:42.216721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:42.222090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:42.222609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:42.223048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:42.223741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:42.224193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:42.224616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:42.285261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:42.292712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5aeb92b3-3934-4998-a625-ac9e8ae5ab40 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082478 Sep 01 08:36:42.293386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2189/4403] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:42 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:43.313502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:43.314106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:43.320193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:43.320758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:43.321103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:43.321790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:43.322243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:43.322695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:43.385032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:43.392579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c7b40c10-724a-4b84-9de6-0ba4741727d7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082949 Sep 01 08:36:43.393688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2215/4404] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:43 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:44.413244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:44.413857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:44.419814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:44.420284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:44.420710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:44.421380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:44.421824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:44.422238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:44.482325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:44.489833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ca140374-cdb2-46c1-b7d3-332d79922547 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081064 Sep 01 08:36:44.490411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2190/4405] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:44 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:45.510899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:45.511502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:45.517354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:45.517827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:45.518299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:45.518969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:45.519413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:45.519824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:45.579997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:45.588348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7e351a2-cf9a-43e6-b4c3-cfa31cda0298 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081272 Sep 01 08:36:45.588912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2216/4406] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:45 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:46.608857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:46.609494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:46.616093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:46.616564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:46.616990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:46.617657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:46.618098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:46.618537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:46.680868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:46.688458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2a702b6c-4f7c-4f30-a8bf-d667197cadc3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083398 Sep 01 08:36:46.689005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2191/4407] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:46 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:47.710281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:47.710899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:47.716810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:47.717283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:47.717712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:47.718421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:47.718870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:47.719289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:47.781364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:47.789681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0dd6e607-1d5c-40cc-8869-114866f536ec tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083932 Sep 01 08:36:47.790234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2217/4408] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:47 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:48.810623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:48.811231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:48.817891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:48.818393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:48.818825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:48.819505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:48.819949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:48.820367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:48.880776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:48.888303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-00af4adf-4eea-458e-91dd-99ae531d651e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081465 Sep 01 08:36:48.888860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2192/4409] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:48 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:49.908882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:49.910101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:49.916071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:49.916539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:49.916962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:49.917633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:49.918073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:49.918517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:49.978415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:49.985768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b8d5c71e-e63d-4a9c-83cb-185875cc7ace tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080783 Sep 01 08:36:49.986344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2218/4410] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:49 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:51.006540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:51.007145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:51.013076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:51.013552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:51.013985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:51.014692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:51.015140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:51.015560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:51.074671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:51.082982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ff0ec2d9-b3ac-443f-b34e-45ecca1348f9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080400 Sep 01 08:36:51.083541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2193/4411] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:51 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:52.103691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:52.104298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:52.110350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:52.110829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:52.111259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:52.111932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:52.112380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:52.113367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:52.174322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:52.182580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d9c89284-2e37-45b2-9acf-b7e30e01bd7a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082635 Sep 01 08:36:52.183130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2219/4412] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:52 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:53.203209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:53.203800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:53.210199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:53.210704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:53.211133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:53.211810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:53.212307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:53.212669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:53.273556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:53.281463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-df741beb-940c-494c-9b1c-64174700c49a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082334 Sep 01 08:36:53.282032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2194/4413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:53 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:54.302120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:54.302778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:54.308664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:54.309133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:54.309561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:54.310231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:54.310712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:54.311149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:54.313588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:54.371275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:54.379240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c8bb5eae-1455-4136-8709-29313fa01d31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081014 Sep 01 08:36:54.379787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2220/4414] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:54 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:55.399923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:55.400534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:55.406412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:55.406884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:55.407308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:55.407997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:55.408441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:55.408853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:55.472577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:55.480380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-41e238b1-526c-4568-8c79-e1a45dc28246 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084233 Sep 01 08:36:55.480930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2195/4415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:55 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:56.500863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:56.501464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:56.507392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:56.507863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:56.508293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:56.508962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:56.509402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:56.509816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:56.573743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:56.582017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc4192a4-67e3-4b03-962a-de47c3d3fa8e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084904 Sep 01 08:36:56.582627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2221/4416] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:56 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:57.602513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:57.603179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:57.608998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:57.609469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:57.609891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:57.610586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:57.611028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:57.611440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:57.671925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:57.680619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b159605e-ea7e-4f9f-be53-c44dba8b544d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081993 Sep 01 08:36:57.681171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2196/4417] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:57 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:58.701908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:58.702570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:58.709137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:58.709617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:58.710047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:58.710757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:58.711206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:58.711626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:58.771546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:58.779560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-933eb9de-d496-405b-9d0e-724c1c2cf84d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081760 Sep 01 08:36:58.780123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2222/4418] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:58 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:36:59.801328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:36:59.801928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:36:59.807839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:59.808321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:59.808752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:59.809426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:36:59.809872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:36:59.810306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:36:59.870590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:36:59.878502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f338c04-9284-40e3-aed3-258690be59ac tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081536 Sep 01 08:36:59.879112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2197/4419] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:36:59 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:00.899884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:00.900483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:00.906376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:00.906857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:00.907281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:00.907945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:00.908391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:00.908802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:00.971652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:00.979426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3434328d-6d7d-4f2d-bdb8-c6830abc65ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083336 Sep 01 08:37:00.979993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2223/4420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:00 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:01.999693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:02.000318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:02.007133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:02.007614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:02.008077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:02.008758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:02.009206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:02.009626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:02.070070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:02.077965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0112f578-af4c-4267-85f2-2b1bcb7f37f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082041 Sep 01 08:37:02.078556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2198/4421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:01 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:03.099748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:03.100352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:03.106432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:03.106853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:03.107371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:03.107965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:03.108417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:03.108830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:03.169620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:03.177408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2b635096-e1b4-4e19-b2a9-74c2accb27eb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082212 Sep 01 08:37:03.177964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2224/4422] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:03 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:04.199322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:04.199960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:04.208672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:04.209153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:04.209579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:04.210283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:04.210732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:04.211151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:04.270775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:04.278241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-127e9bcd-a3ee-4a2b-addb-b1ffd3524d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084224 Sep 01 08:37:04.278821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2199/4423] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:04 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:05.299360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:05.299995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:05.305847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:05.306352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:05.306785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:05.307461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:05.307906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:05.308326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:05.373814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:05.381544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c28c9f6f-2826-44c0-8eee-8b387b66b935 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086108 Sep 01 08:37:05.382097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2225/4424] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:05 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:06.402456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:06.403073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:06.409466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:06.410078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:06.410599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:06.411278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:06.411726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:06.412148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:06.473310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:06.480934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c9ad717-14af-4891-a4a4-f0fa1e0654c5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082307 Sep 01 08:37:06.481504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2200/4425] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:06 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:07.502042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:07.503290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:07.509338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:07.509806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:07.510227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:07.510922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:07.511362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:07.511776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:07.573318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:07.581792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-071f5bc4-818b-427e-91f6-22479c647f9b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083394 Sep 01 08:37:07.582399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2226/4426] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:07 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:08.603034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:08.603710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:08.609793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:08.610314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:08.610782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:08.611473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:08.611897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:08.612980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:08.674278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:08.682492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e207ca04-9265-420d-9241-19493d2875c6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083288 Sep 01 08:37:08.683048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2201/4427] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:08 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:09.703321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:09.703944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:09.710415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:09.710883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:09.711305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:09.711970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:09.712409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:09.712829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:09.775416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:09.782641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea1d2756-ae2e-4b2c-ae90-a816c891d758 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083400 Sep 01 08:37:09.783196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2227/4428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:09 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:10.803762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:10.804376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:10.810636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:10.811112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:10.811540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:10.812228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:10.812669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:10.813081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:10.815873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:10.874673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:10.883334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f7332ee-1f9e-4763-86b6-5dc58835fe58 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084482 Sep 01 08:37:10.883901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2202/4429] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:10 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:11.903903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:11.904521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:11.906499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:11.912229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:11.912710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:11.913298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:11.914111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:11.914581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:11.915060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:11.978214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:11.986523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-11e74675-b096-4f52-8f31-0844175a4ee4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086383 Sep 01 08:37:11.987752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2228/4430] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:11 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:13.008448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:13.009050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:13.010884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:13.016240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:13.016711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:13.017137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:13.017810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:13.018947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:13.019417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:13.081540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:13.094165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4b9f0341-4c44-4f98-926c-afe1dec419f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.089294 Sep 01 08:37:13.095110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2203/4431] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:13 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:14.125008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:14.125617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:14.132241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:14.132718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:14.133139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:14.133814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:14.134252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:14.134707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:14.200680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:14.208911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0186a0c-65c5-4ddf-a0fb-88a236e1fb14 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088043 Sep 01 08:37:14.209466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2229/4432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:14 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:15.230167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:15.230832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:15.236649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:15.237720 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:15.238145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:15.238852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:15.239298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:15.239718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:15.298834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:15.307465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0317cfd6-4e48-47dd-b857-f3d8afb4b0af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081234 Sep 01 08:37:15.308210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2204/4433] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:15 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:16.328823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:16.329444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:16.337428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:16.338311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:16.339197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:16.340172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:16.340622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:16.341042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:16.401374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:16.411680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d7c6b668-4229-4b60-b6c9-d9d0d4ffe637 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086850 Sep 01 08:37:16.412238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2230/4434] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:16 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:17.432173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:17.432870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:17.439546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:17.440027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:17.440561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:17.441303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:17.441893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:17.442337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:17.502638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:17.510271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9bf60ada-7174-4a37-a05b-5c0273ce7994 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082039 Sep 01 08:37:17.510842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2205/4435] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:17 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:18.530638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:18.531278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:18.537219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:18.537698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:18.538137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:18.538862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:18.539309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:18.539730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:18.604711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:18.612692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3e84343-ec17-4097-a2fd-788ed34531b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085778 Sep 01 08:37:18.613336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2231/4436] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:18 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:19.634590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:19.635184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:19.641053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:19.641523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:19.641951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:19.642644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:19.643084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:19.643502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:19.703813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:19.711957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bb6a5fe1-403b-41a4-9b12-6d018436a6b1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081851 Sep 01 08:37:19.712510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2206/4437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:19 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:20.732634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:20.733221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:20.739014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:20.740126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:20.740638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:20.741320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:20.741765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:20.742183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:20.802935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:20.810381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0fc0dc85-6104-45fd-aecf-ce775b07e208 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081661 Sep 01 08:37:20.810931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2232/4438] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:20 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:21.832389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:21.833021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:21.841073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:21.841556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:21.841985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:21.842709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:21.843157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:21.843574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:21.904957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:21.913240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b8a9caa4-9539-4be3-b2c0-17e25bda99df tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084696 Sep 01 08:37:21.913793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2207/4439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:21 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:22.933458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:22.934108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:22.940478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:22.940954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:22.941384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:22.942059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:22.943070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:22.943496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:23.007203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:23.014705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c25f19d7-ea85-4b7d-9e96-f76959fb8a97 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085070 Sep 01 08:37:23.015272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2233/4440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:22 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:24.035777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:24.037035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:24.042961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:24.043444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:24.043876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:24.044557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:24.045002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:24.045421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:24.105313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:24.112834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-845a436b-b73d-4592-ae5b-18389c996bd0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080865 Sep 01 08:37:24.113386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2208/4441] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:24 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:25.133610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:25.134178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:25.140321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:25.140799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:25.141225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:25.141896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:25.142372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:25.142787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:25.145245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:25.203760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:25.211724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a2aeff64-25f8-4ee3-a719-74936b83be41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082645 Sep 01 08:37:25.212290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2234/4442] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:25 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:26.232940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:26.233658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:26.240128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:26.240609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:26.241046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:26.241728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:26.242173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:26.242618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:26.304015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:26.311741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-289e2a7d-2ab7-460b-982a-0b57db84c4ea tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082672 Sep 01 08:37:26.312302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2209/4443] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:26 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:27.332482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:27.333222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:27.339599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:27.340070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:27.340498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:27.341167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:27.341608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:27.342020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:27.404232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:27.412839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5e110c52-f066-43c1-9757-52c540fdb158 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084150 Sep 01 08:37:27.413394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2235/4444] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:27 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:28.433263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:28.433876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:28.439786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:28.440255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:28.440679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:28.441358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:28.441798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:28.442213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:28.503062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:28.510744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6d4ad97d-9d89-4473-9b15-3900d04f388e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081367 Sep 01 08:37:28.511326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2210/4445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:28 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:29.531773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:29.532382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:29.539266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:29.539746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:29.540177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:29.540863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:29.541308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:29.541732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:29.603029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:29.611204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20ee34d4-85ac-44fd-bf72-9c9d851d2b46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083306 Sep 01 08:37:29.611759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2236/4446] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:29 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:30.854829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:30.855478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:30.861544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:30.862021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:30.862481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:30.863167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:30.863618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:30.864035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:30.924302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:30.932685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5bff2f46-527d-42db-9f62-c232d657fb45 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.304093 Sep 01 08:37:30.933261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2211/4447] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:30 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:31.953401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:31.954032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:31.960042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:31.960508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:31.960932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:31.961599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:31.962043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:31.962481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:32.025877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:32.033579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ef4ad13d-8fbb-403f-9eea-de87d6e88368 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084363 Sep 01 08:37:32.034143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2237/4448] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:31 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:33.054580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:33.055183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:33.060964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:33.061441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:33.061872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:33.062572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:33.063014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:33.063429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:33.123567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:33.132046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2004450c-a4c6-4e8b-b581-1c53a7538506 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081975 Sep 01 08:37:33.132627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2212/4449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:33 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:34.152380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:34.153030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:34.158888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:34.159358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:34.159784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:34.160454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:34.161550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:34.161983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:34.221257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:34.228990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e94d882-4927-4760-918f-bcc8708f861c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080307 Sep 01 08:37:34.229560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2238/4450] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:34 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:35.250606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:35.251166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:35.257373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:35.257842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:35.258285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:35.259006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:35.259411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:35.259827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:35.318829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:35.326844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-02a749d9-dbe3-469e-b55a-8a098f2dd7d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080140 Sep 01 08:37:35.327409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2213/4451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:35 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:36.347324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:36.347942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:36.355248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:36.355728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:36.356174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:36.356976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:36.357424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:36.357849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:36.423295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:36.431824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aa976058-aaf1-48b2-be1f-4c1a5eb2ba49 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088313 Sep 01 08:37:36.432399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2239/4452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:36 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:37.455115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:37.455718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:37.462397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:37.462875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:37.463311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:37.463986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:37.464434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:37.464854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:37.527920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:37.535365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c11ed391-9570-4dfc-832e-f6be18f6b80d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084132 Sep 01 08:37:37.536446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2214/4453] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:37 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:38.557741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:38.558360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:38.564223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:38.564694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:38.565117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:38.565804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:38.566228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:38.566666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:38.628694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:38.637331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-84649309-1164-4c3e-828b-521976b4f862 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083449 Sep 01 08:37:38.637885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2240/4454] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:38 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:39.656919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:39.657530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:39.664221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:39.664700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:39.665134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:39.665813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:39.666281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:39.666752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:39.727283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:39.734888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e1cdd14f-a24f-4b25-87a0-48ac3d14ff73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081810 Sep 01 08:37:39.735452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2215/4455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:39 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:37:40.755509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:40.756084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:40.761961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:40.762484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:40.762917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:40.763597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:40.764043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:40.764462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:40.830563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:40.838483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fadba636-1feb-4372-b97e-1f352afb85b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086913 Sep 01 08:37:40.839044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2241/4456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:40 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:41.858996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:41.859588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:41.865586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:41.866064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:41.866522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:41.867199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:41.867642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:41.868058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:41.871937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:41.930895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:41.938638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ac88fdb-85e2-4412-94b4-33a4af57df62 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083500 Sep 01 08:37:41.939196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2216/4457] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:41 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:37:42.959763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:42.960400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:42.962251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:42.967435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:42.967913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:42.968344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:42.969033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:42.969476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:42.969896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:43.035848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:43.045341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3674a3c-6887-4fbb-bb07-32413b8a21f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.089398 Sep 01 08:37:43.045823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2242/4458] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:42 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:44.067123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:44.067794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:44.069752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:44.075419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:44.075896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:44.076324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:44.077001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:44.077445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:44.077863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:44.137098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:44.144820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-06c55456-667d-4e03-ac2a-2db298e64520 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081450 Sep 01 08:37:44.145483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2217/4459] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:44 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:45.165731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:45.166373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:45.172882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:45.173360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:45.173797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:45.174512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:45.174965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:45.175386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:45.239371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:45.246850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2b20316-6073-48bd-915d-38cc3e09b534 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085368 Sep 01 08:37:45.247418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2243/4460] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:45 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:46.266475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:46.267087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:46.273628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:46.274099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:46.274555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:46.275231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:46.275678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:46.276097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:46.335484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:46.342937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6949f1c7-ada9-49f9-bdfe-68535d83b775 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080307 Sep 01 08:37:46.343485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2218/4461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:46 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:47.363324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:47.364102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:47.369930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:47.370441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:47.370873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:47.371552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:47.372029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:47.372451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:47.431880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:47.439668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-eacff520-cb77-40d8-8a83-334f52469f48 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079931 Sep 01 08:37:47.440238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2244/4462] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:47 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:48.461053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:48.461735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:48.467846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:48.468322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:48.468750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:48.469430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:48.469868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:48.470300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:48.530399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:48.538557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-116c7720-64ca-483c-8127-3cd394a809d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081656 Sep 01 08:37:48.539117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2219/4463] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:48 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:49.559849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:49.560448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:49.566386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:49.566855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:49.567607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:49.568285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:49.568723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:49.569140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:49.631810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:49.639345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2558bb88-db1d-456a-a976-c6bcdace5139 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083323 Sep 01 08:37:49.639911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2245/4464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:49 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:50.660245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:50.661101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:50.666949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:50.667421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:50.667849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:50.668527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:50.668967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:50.669383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:50.730556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:50.738099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-114e4e19-bf7d-4a9d-ae4c-f3578184155b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081667 Sep 01 08:37:50.738701 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2220/4465] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:50 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:51.759502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:51.760084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:51.765811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:51.766321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:51.766750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:51.767422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:51.767863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:51.768277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:51.828042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:51.836334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-78cf032c-bdf5-4a92-a4ef-e83af612f311 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080774 Sep 01 08:37:51.836943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2246/4466] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:51 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:52.856251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:52.856878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:52.863004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:52.863487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:52.863926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:52.865162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:52.865616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:52.866131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:52.926284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:52.934308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f77e6e2-0b78-4318-9931-478fdffb432a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081823 Sep 01 08:37:52.934860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2221/4467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:52 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:53.955536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:53.956166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:53.962682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:53.963156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:53.963578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:53.964249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:53.964692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:53.965105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:54.027784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:54.035664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-48d97511-15c2-4f8c-ad2e-b6b2fc85dd3c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083927 Sep 01 08:37:54.036273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2247/4468] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:53 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:37:55.057163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:55.057737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:55.063647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:55.064119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:55.064544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:55.065213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:55.065655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:55.066072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:55.125945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:55.134377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-132fec4d-688d-45b8-8d66-fb1dc6e17257 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081067 Sep 01 08:37:55.134933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2222/4469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:55 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:56.154723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:56.155315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:56.161065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:56.161534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:56.161963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:56.162654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:56.163132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:56.163548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:56.166129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:56.223850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:56.232875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf6f7029-1328-44e8-bbfb-63af57d1d75e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081857 Sep 01 08:37:56.233538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2248/4470] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:56 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:57.255908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:57.256459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:57.263152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:57.263621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:57.264045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:57.264715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:57.265157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:57.265570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:57.326058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:57.333547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-58424c18-9c7c-4d7b-9ab1-bd5b518a2699 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081567 Sep 01 08:37:57.334094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2223/4471] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:57 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:58.354431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:58.355029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:58.356973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:37:58.357102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:37:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 (ip 10.222.0.43) !!! Sep 01 08:37:58.363296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:58.363764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:58.364189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:58.364859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:58.365298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:58.365717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:58.431567 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:58.439330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cf4fbaed-8cc6-4283-9b9e-583deefec124 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088785 Sep 01 08:37:58.439883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2249/4472] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:58 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:37:59.461086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:37:59.461805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:37:59.467818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:59.468289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:59.468708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:59.469383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:37:59.469821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:37:59.470231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:37:59.530539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:37:59.538002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5eaac424-a91b-4979-84e8-57a6911abe50 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081245 Sep 01 08:37:59.539314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2224/4473] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:37:59 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:00.560241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:00.560862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:00.566690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:00.567157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:00.567581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:00.568248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:00.568688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:00.569108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:00.629663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:00.638283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3016d28d-f588-4c34-b671-929a2491e8b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081758 Sep 01 08:38:00.638843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2250/4474] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:00 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:01.658630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:01.659228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:01.665782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:01.666275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:01.666699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:01.667380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:01.667822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:01.668239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:01.727748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:01.735345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-415e687b-0b96-4846-9a2e-ed6486645c80 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080539 Sep 01 08:38:01.735911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2225/4475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:01 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:02.755811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:02.756390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:02.762484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:02.762962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:02.763393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:02.764077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:02.764549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:02.765000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:02.827753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:02.835357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4bd9f75c-d878-4c8c-934d-2902b934a2e4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083456 Sep 01 08:38:02.836063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2251/4476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:02 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:03.855842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:03.856440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:03.862387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:03.862868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:03.863301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:03.863984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:03.864429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:03.864848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:03.924718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:03.932918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6aae160a-4a6f-48d7-b6a6-8a0d634a8121 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080947 Sep 01 08:38:03.933485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2226/4477] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:03 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:38:04.954186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:04.954819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:04.961463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:04.961936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:04.962398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:04.963083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:04.963556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:04.963974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:05.022399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:05.032871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-00f8d9c6-ae08-4f7f-a227-ad00307277d2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082488 Sep 01 08:38:05.033439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2252/4478] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:04 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:06.054800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:06.055474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:06.061346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:06.061824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:06.062252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:06.062956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:06.063399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:06.063817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:06.123838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:06.131375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f44d79f-b16c-48d6-a73c-1ace5d829d8f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081177 Sep 01 08:38:06.131946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2227/4479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:06 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:07.152805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:07.153368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:07.159232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:07.159704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:07.160130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:07.160799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:07.161235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:07.161649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:07.224869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:07.232662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-409ee52c-747d-4cdb-94a9-e256c4cde18e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083772 Sep 01 08:38:07.233215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2253/4480] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:07 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:08.253505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:08.254147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:08.260217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:08.260691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:08.261116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:08.261783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:08.262224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:08.262664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:08.321933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:08.330138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-12a8efc2-cbcc-4a24-87a1-094ee4b3e378 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080457 Sep 01 08:38:08.330731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2228/4481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:08 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:09.356122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:09.356706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:09.362659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:09.363134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:09.363560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:09.364235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:09.364676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:09.365090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:09.424132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:09.431902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1318b68-dc56-42e1-ba58-38c710a6b3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079654 Sep 01 08:38:09.432458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2254/4482] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:09 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:38:10.453171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:10.453758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:10.459660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:10.460237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:10.460678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:10.461351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:10.461792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:10.462207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:10.522094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:10.530617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f04884ac-d4a7-489b-a719-b883fdb8b651 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081630 Sep 01 08:38:10.531173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2229/4483] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:10 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:11.552171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:11.552808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:11.558815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:11.559292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:11.559718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:11.560395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:11.560840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:11.561259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:11.628000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:11.636586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5757fc64-184e-4ad4-824e-9a550c85f0f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088238 Sep 01 08:38:11.637145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2255/4484] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:11 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:12.656932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:12.657542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:12.664259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:12.664766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:12.665199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:12.665878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:12.666389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:12.666813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:12.669331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:12.727193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:12.734704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-842845ba-7561-42eb-a242-e39db23f3424 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081648 Sep 01 08:38:12.735261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2230/4485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:12 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:13.755900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:13.756623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:13.758715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:13.764721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:13.765256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:13.765625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:13.766335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:13.766780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:13.767194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:13.827794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:13.835882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-05c9a80d-6083-435b-93a5-3015fd7e1de6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084098 Sep 01 08:38:13.836425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2256/4486] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:13 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:14.856740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:14.857348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:14.859195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:14.864415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:14.864892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:14.865323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:14.866000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:14.866724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:14.867175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:14.926876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:14.934548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b034a14a-5778-47b3-9f15-035c9dfc2d73 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081646 Sep 01 08:38:14.935133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2231/4487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:14 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:15.955571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:15.956195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:15.962854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:15.963327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:15.963754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:15.964430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:15.964866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:15.965280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:16.026826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:16.034346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5439b017-6bac-4150-8090-3789605bba99 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082537 Sep 01 08:38:16.034900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2257/4488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:15 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:17.055792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:17.056411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:17.062412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:17.062818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:17.063246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:17.063924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:17.064372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:17.064791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:17.123914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:17.131483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f989dfaa-2094-41e5-9c78-c652d847e63c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080208 Sep 01 08:38:17.132116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2232/4489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:17 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:18.152253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:18.152887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:18.158835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:18.159307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:18.159747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:18.160407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:18.160851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:18.161267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:18.220502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:18.228667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-df20e231-6841-46cb-a615-499759bdcc5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080371 Sep 01 08:38:18.229238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2258/4490] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:18 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:19.248944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:19.249543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:19.255598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:19.256077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:19.256504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:19.257186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:19.257632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:19.258045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:19.316977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:19.325106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-51f716b5-4541-4522-9643-d763bfe5220c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080086 Sep 01 08:38:19.325660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2233/4491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:19 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:20.345656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:20.346322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:20.352633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:20.353084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:20.353507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:20.354173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:20.354636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:20.355048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:20.419177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:20.426932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b388d6cb-2827-4ccd-924d-3bc0dafd3e2b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085104 Sep 01 08:38:20.427495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2259/4492] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:20 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:21.448598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:21.449396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:21.455731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:21.456214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:21.456638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:21.457329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:21.457765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:21.458244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:21.518874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:21.527740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9fd64b1-12f0-43ae-829e-df345f1a839c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083615 Sep 01 08:38:21.528320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2234/4493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:21 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:22.549624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:22.550297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:22.556878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:22.557349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:22.557778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:22.558481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:22.558930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:22.559350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:22.620511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:22.628460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8dfa2f50-9cec-4791-819a-9e9ab3c81bb4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082709 Sep 01 08:38:22.629027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2260/4494] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:22 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:23.649417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:23.650043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:23.656102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:23.656608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:23.657040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:23.657747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:23.658198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:23.658678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:23.726554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:23.734107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-63b38c73-5713-4e64-9fbd-aefafef15303 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.089031 Sep 01 08:38:23.734697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2235/4495] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:23 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:24.754989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:24.755547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:24.762049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:24.762569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:24.763002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:24.763676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:24.764124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:24.764540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:24.827617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:24.835260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d123244-426b-4e36-ac59-633b94e3a2b8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084203 Sep 01 08:38:24.835823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2261/4496] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:24 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:25.855877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:25.856498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:25.862447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:25.862928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:25.863359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:25.864038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:25.864479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:25.864900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:25.924425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:25.932686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d8aa8c5c-4648-4492-a56e-a3af98e82d15 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080548 Sep 01 08:38:25.933521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2236/4497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:25 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:38:26.955277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:26.955864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:26.961999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:26.962501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:26.962934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:26.963613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:26.964059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:26.964475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:26.966965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:27.024578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:27.032166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5007033e-4d83-4601-b767-7342f9f8948f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080667 Sep 01 08:38:27.032724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2262/4498] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:26 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:28.053220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:28.053824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:28.059715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:28.060187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:28.060610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:28.061283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:28.061727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:28.062139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:28.123146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:28.130605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1f1f1320-670d-4ff1-b5a1-15862c07b95d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081244 Sep 01 08:38:28.131161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2237/4499] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:28 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:29.151382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:29.152161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:29.157798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:29.158281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:29.158724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:29.159393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:29.159833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:29.160245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:29.224129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:29.232340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce41ccf6-a043-4241-a7fd-f809b67bde4c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085910 Sep 01 08:38:29.232899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2263/4500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:29 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:30.252943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:30.253542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:30.259490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:30.259963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:30.260391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:30.261067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:30.261575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:30.261993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:30.321174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:30.328836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5bc11317-3500-43cc-bd9c-d2f219d4f0ef tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079720 Sep 01 08:38:30.329386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2238/4501] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:30 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:31.350043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:31.350664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:31.356637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:31.357110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:31.357541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:31.358213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:31.358686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:31.359106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:31.418362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:31.425801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-efdedd82-b4e5-4a3d-a3d8-80c232f01a5f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079539 Sep 01 08:38:31.426402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2264/4502] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:31 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:32.447172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:32.447761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:32.454091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:32.454597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:32.455029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:32.455698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:32.456144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:32.456563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:32.516111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:32.523781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ff97671f-39ec-429c-8a0b-193a8159cbf2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081078 Sep 01 08:38:32.524341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2239/4503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:32 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:33.545743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:33.546369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:33.552331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:33.552807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:33.553267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:33.554682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:33.555155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:33.555815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:33.620571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:33.628392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-135dddd2-2f45-4b53-bc79-efed7c9dcfbc tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086842 Sep 01 08:38:33.628954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2265/4504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:33 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:34.649475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:34.650229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:34.656116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:34.656589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:34.657010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:34.657708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:34.658234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:34.658584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:34.718509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:34.726860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2395058a-4fdd-4728-be8f-abfd88a5831a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080955 Sep 01 08:38:34.727339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2240/4505] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:34 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:35.746685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:35.747254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:35.753196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:35.753667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:35.754091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:35.754804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:35.755250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:35.755669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:35.817943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:35.826767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-490ba170-ddb8-4887-82e9-4b1a984b4262 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084084 Sep 01 08:38:35.827356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2266/4506] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:35 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:36.848116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:36.848709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:36.854713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:36.855189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:36.855620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:36.856299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:36.856770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:36.857188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:36.916936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:36.929786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-df585cf5-58cd-4fbf-909f-ee67d3d42684 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084872 Sep 01 08:38:36.930384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2241/4507] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:36 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:37.953174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:37.953790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:37.959730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:37.960265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:37.960734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:37.961439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:37.961881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:37.962383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:38.024302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:38.031789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6ce72770-a330-411f-9874-f2add4326c3f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082781 Sep 01 08:38:38.032345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2267/4508] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:37 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:39.052628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:39.053220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:39.059811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:39.060270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:39.060704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:39.061383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:39.061832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:39.062277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:39.121673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:39.129156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-581762e4-3c69-48f9-8414-aba0fc3428e1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080344 Sep 01 08:38:39.129713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2242/4509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:39 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:40.150552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:40.151168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:40.157160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:40.157641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:40.158048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:40.158755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:40.159199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:40.159641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:40.221526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:40.229782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ed9f3e6-3c68-4aa8-9cd3-ef1eaafdefa5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083171 Sep 01 08:38:40.230355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2268/4510] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:40 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:41.251157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:41.251725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:41.257549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:41.258022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:41.258497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:41.259174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:41.259620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:41.260071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:41.319064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:41.327231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-72eb27d5-e9ce-445c-8917-a1411eca0505 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079942 Sep 01 08:38:41.327827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2243/4511] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:41 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:42.348264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:42.348884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:42.355705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:42.356178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:42.356603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:42.357305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:42.357744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:42.358174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:42.419487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:42.426978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-acc3817b-77b8-4485-ab21-124df99ffbbb tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082492 Sep 01 08:38:42.427534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2269/4512] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:42 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:43.447050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:43.447658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:43.454140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:43.454652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:43.455081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:43.455757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:43.456201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:43.456616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:43.459132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:43.516779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:43.524405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-44178df3-8fa0-4f84-b96a-7559f73a12a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081346 Sep 01 08:38:43.524953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2244/4513] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:43 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:44.545280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:44.545921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:44.547754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:44.553012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:44.553490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:44.558041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:44.558765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:44.559216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:44.559634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:44.625458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:44.633499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c54ebaf5-7926-4bda-9a95-2a683d0ced64 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.092023 Sep 01 08:38:44.634071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2270/4514] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:44 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:45.654392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:45.655010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:45.656778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:45.662008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:45.662508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:45.663484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:45.664165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:45.664608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:45.665022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:45.724844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:45.733492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6586f71c-ada8-4c92-b704-dcf51c0097a7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082889 Sep 01 08:38:45.738415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2245/4515] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:45 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:46.754465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:46.755033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:46.761547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:46.762020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:46.762470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:46.763146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:46.763583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:46.763999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:46.826001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:46.833513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d04f716a-d20a-479b-9cb2-29ef846f004b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082970 Sep 01 08:38:46.834065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2271/4516] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:46 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:47.853462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:47.854068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:47.859974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:47.860457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:47.860885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:47.861559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:47.862006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:47.862450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:47.921241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:47.929668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-585a43c9-fe26-4689-9eb0-af39a9ff95cd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079684 Sep 01 08:38:47.930274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2246/4517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:47 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:48.950629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:48.951215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:48.957106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:48.957931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:48.958387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:48.959055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:48.959519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:48.960488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:49.019615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:49.028057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aaf6149f-296d-4d2e-b44f-dca9b846e242 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081558 Sep 01 08:38:49.028605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2272/4518] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:48 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:50.049052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:50.049702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:50.056286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:50.056765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:50.057198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:50.057911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:50.058390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:50.058816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:50.119213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:50.126829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7cb7495c-0b79-49d0-8fb1-921d2b3c71d9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081621 Sep 01 08:38:50.127392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2247/4519] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:50 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:51.148418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:51.149015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:51.154865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:51.155339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:51.155761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:51.156434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:51.156876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:51.157287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:51.220055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:51.228184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3949e772-c1a5-449b-8778-37d7c39526bd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084300 Sep 01 08:38:51.228750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2273/4520] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:51 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:52.248627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:52.249230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:52.255523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:52.256006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:52.256938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:52.257629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:52.258070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:52.258525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:52.317006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:52.325357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a82de686-2eca-4d5c-86b5-03c0e973803f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080549 Sep 01 08:38:52.325923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2248/4521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:52 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:53.346431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:53.347017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:53.353858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:53.354355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:53.354785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:53.355455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:53.355894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:53.356306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:53.414722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:53.422712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-37613ed6-82a2-4f20-a993-c21fcdad1630 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080047 Sep 01 08:38:53.423268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2274/4522] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:53 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:54.443117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:54.443761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:54.450711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:54.451200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:54.451740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:54.452364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:54.452813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:54.453260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:54.513063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:54.520561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ad2145e-d6ae-49e3-8c26-1122e07f6afe tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081309 Sep 01 08:38:54.521108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2249/4523] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:54 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:55.542086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:55.542712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:55.548527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:55.549005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:55.549436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:55.550193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:55.550599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:55.551059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:55.616580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:55.624820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-761b9c5e-3642-4873-abd7-8aa28c2d5188 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.086714 Sep 01 08:38:55.625383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2275/4524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:55 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:56.646187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:56.646814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:56.653567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:56.654074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:56.654534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:56.655215 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:56.655657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:56.656453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:56.718719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:56.726342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1a7591da-df93-48c4-ba57-dcbf1392252b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083965 Sep 01 08:38:56.726838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2250/4525] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:56 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:57.748533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:57.749111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:57.754970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:57.755700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:57.756136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:57.756809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:57.757252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:57.757665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:57.760364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:57.818555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:57.826560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-938a917e-e10b-4716-b7ec-9351619ebb46 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082300 Sep 01 08:38:57.827125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2276/4526] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:57 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:58.847633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:58.848230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:58.856165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:58.856635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:58.857061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:58.857874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:58.858423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:58.858940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:58.920639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:38:58.928126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7985dd43-710d-484f-a2d7-6539b1450caa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084368 Sep 01 08:38:58.928687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2251/4527] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:58 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:38:59.948382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:38:59.949279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:38:59.955163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:59.955636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:59.956062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:38:59.956732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:38:59.957184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:38:59.957583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:00.019264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:00.027368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0e4f876-40f1-45d5-9825-2ac69b140eaa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083146 Sep 01 08:39:00.027939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2277/4528] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:38:59 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:01.047814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:01.048441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:01.054409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:01.054886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:01.055888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:01.056573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:01.057023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:01.057444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:01.116514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:01.124534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4381e41-0bd2-466a-af9d-42205d8ef27b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080581 Sep 01 08:39:01.125095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2252/4529] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:01 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:02.145007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:02.145622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:02.151735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:02.152207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:02.152633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:02.153320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:02.153764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:02.154186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:02.214291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:02.222285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1307ce36-74fd-43fb-ab8b-a2fcccb5a002 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081091 Sep 01 08:39:02.222919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2278/4530] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:02 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:03.242719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:03.243281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:03.249077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:03.249545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:03.249969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:03.250670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:03.251111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:03.251524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:03.311085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:03.318502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a994fa38-de2e-489b-929a-38b3d3230c55 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079720 Sep 01 08:39:03.319059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2253/4531] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:03 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:04.340029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:04.340753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:04.347043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:04.347515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:04.347936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:04.348602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:04.349042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:04.349452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:04.411203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:04.419270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6cdd771a-b202-4e13-be58-60ed35c37805 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084020 Sep 01 08:39:04.419828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2279/4532] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:04 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:05.440541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:05.441223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:05.447811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:05.448529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:05.448963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:05.449632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:05.450074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:05.450518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:05.509597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:05.517332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec04c6a9-526e-487e-9d32-e4f58ebda3f6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080508 Sep 01 08:39:05.517980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2254/4533] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:05 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:06.537915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:06.538623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:06.545359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:06.545839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:06.546332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:06.547019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:06.547474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:06.547894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:06.619878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:06.625409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f6613a0e-c8ad-413f-b474-1f22207dec32 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.091253 Sep 01 08:39:06.625960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2280/4534] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:06 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:07.646290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:07.646889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:07.652920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:07.653397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:07.653830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:07.654537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:07.654990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:07.655408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:07.715134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:07.722732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b7fccb90-f530-43ae-9922-abc2a5fdef4e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080049 Sep 01 08:39:07.723230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2255/4535] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:07 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:08.743303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:08.743870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:08.749611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:08.750079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:08.750544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:08.751221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:08.751692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:08.752079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:08.813712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:08.821940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f41fbce4-7bfb-4b25-aa03-21b1535982ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082694 Sep 01 08:39:08.822535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2281/4536] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:08 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:09.843051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:09.843671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:09.849537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:09.850010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:09.850478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:09.851158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:09.851603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:09.852605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:09.912679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:09.921288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f2cb6d56-b513-42e8-a92e-7408db050478 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081997 Sep 01 08:39:09.921863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2256/4537] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:09 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:10.942177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:10.942821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:10.949069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:10.949538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:10.949968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:10.950685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:10.951131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:10.951547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:11.011682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:11.019201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-12a0196b-c301-45fb-8f43-35544750c2b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080843 Sep 01 08:39:11.019758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2282/4538] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:10 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:12.040281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:12.040898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:12.047136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:12.047655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:12.048083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:12.048847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:12.049338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:12.049809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:12.109413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:12.116911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2e3607dc-4b0c-4176-bb2e-d8a167a6c399 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081258 Sep 01 08:39:12.118024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2257/4539] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:12 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:13.137771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:13.138373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:13.144883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:13.145358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:13.145787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:13.146490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:13.146932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:13.147347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:13.209373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:13.216980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e88642ca-b608-4633-b8b1-786816687d42 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083101 Sep 01 08:39:13.217552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2283/4540] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:13 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:14.237806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:14.238456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:14.244845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:14.245311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:14.245742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:14.246453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:14.246893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:14.247308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:14.249808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:14.307426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:14.315238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-52be7377-f0b9-4b7a-99f7-b0e6a181d6a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081241 Sep 01 08:39:14.315824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2258/4541] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:14 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:15.336978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:15.337618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:15.339522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:15.344554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:15.345035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:15.345462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:15.346140 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:15.346614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:15.347034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:15.406146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:15.413613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4dda70c8-7591-41bf-ae6d-ae92107554a0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080495 Sep 01 08:39:15.414173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2284/4542] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:15 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:16.434564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:16.435195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:16.437145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:16.445229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:16.445229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:16.445229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:16.445229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:16.445795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:16.445795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:16.507482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:16.516044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f2473ffa-90f5-4689-9baf-cc20f91dd0de tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085474 Sep 01 08:39:16.516683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2259/4543] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:16 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:17.537021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:17.537626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:17.544262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:17.544745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:17.545172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:17.545846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:17.546317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:17.546851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:17.609509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:17.617279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9b696a8-89b8-4d58-9dd0-31b04d81e834 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084129 Sep 01 08:39:17.617831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2285/4544] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:17 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:18.638013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:18.638635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:18.644540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:18.645014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:18.645447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:18.646124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:18.646602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:18.647020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:18.707714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:18.715859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4c21fa00-01f4-48fd-9fac-9f66abe0d78d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081762 Sep 01 08:39:18.716589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2260/4545] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:18 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:19.736845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:19.737414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:19.743271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:19.743736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:19.744161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:19.744830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:19.745271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:19.745685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:19.807082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:19.813682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-74c45b62-5459-4a4b-b78f-1e4354eebb90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080708 Sep 01 08:39:19.814241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2286/4546] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:19 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:20.835234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:20.835883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:20.842883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:20.843370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:20.843807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:20.844498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:20.844952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:20.845380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:20.907242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:20.914968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e964b9d6-1901-4e15-9f7b-bed3752060a2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084182 Sep 01 08:39:20.915624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2261/4547] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:20 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:21.935692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:21.936346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:21.942285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:21.942774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:21.943195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:21.943867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:21.944334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:21.944747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:22.008297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:22.015960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-762e56ae-227f-4231-baaf-9360c2c10ac9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084140 Sep 01 08:39:22.016514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2287/4548] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:21 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:23.037035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:23.037632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:23.044121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:23.044595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:23.045020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:23.045687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:23.046127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:23.046569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:23.106870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:23.114359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6f362684-b347-4f33-885a-d58dd02b218b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081078 Sep 01 08:39:23.114914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2262/4549] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:23 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:24.135110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:24.135715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:24.141708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:24.142179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:24.142632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:24.143302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:24.143772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:24.144189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:24.204279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:24.212354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1bab70fd-a538-48de-abcc-acc75fee1a37 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080736 Sep 01 08:39:24.213086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2288/4550] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:24 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:25.233081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:25.233635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:25.239423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:25.239892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:25.240316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:25.240980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:25.241417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:25.241828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:25.301206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:25.308765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-965e74d0-62b4-4025-9dd3-d480b3709f8d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079544 Sep 01 08:39:25.309335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2263/4551] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:25 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:26.329998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:26.330655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:26.336696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:26.337175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:26.337606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:26.338304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:26.338756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:26.339174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:26.400316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:26.408279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-73c5314b-1b8d-4613-9681-2ec11a99c8ce tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082107 Sep 01 08:39:26.408846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2289/4552] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:26 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:27.428596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:27.429214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:27.435302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:27.435773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:27.436200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:27.436873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:27.437333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:27.437739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:27.497587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:27.505172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ffdf23ac-dd08-4d8b-b141-bed42698df66 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080387 Sep 01 08:39:27.505727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2264/4553] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:27 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:28.527399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:28.528001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:28.533859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:28.534362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:28.534790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:28.535461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:28.535902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:28.536318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:28.538827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:28.597357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:28.605852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-add4dbb0-32eb-4cee-add3-151959f7c226 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083223 Sep 01 08:39:28.606445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2290/4554] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:28 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:29.626633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:29.627228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:29.633190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:29.633660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:29.634094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:29.634797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:29.635254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:29.635668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:29.696308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:29.704415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5fb6cfe9-6a3a-452c-8ebc-5134df85f456 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081598 Sep 01 08:39:29.704986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2265/4555] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:29 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:30.724362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:30.724930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:30.731831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:30.732315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:30.732750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:30.733439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:30.733891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:30.734370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:30.796910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:30.804421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce2380e5-f73e-451e-9f42-6e392e4794d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083982 Sep 01 08:39:30.804975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2291/4556] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:30 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:31.826000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:31.826623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:31.832987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:31.833470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:31.833904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:31.834627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:31.835075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:31.835495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:32.037787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:32.045363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8df3d342-7a38-40b4-9f69-2b2830f71ef3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.224235 Sep 01 08:39:32.045921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2266/4557] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:31 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:33.065925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:33.066560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:33.073565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:33.074069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:33.074523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:33.075196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:33.075637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:33.076050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:33.135860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:33.143538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f630ea6-ae4d-4be7-b8c9-6352d15607b0 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081407 Sep 01 08:39:33.144098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2292/4558] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:33 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:34.164148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:34.164781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:34.171261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:34.171731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:34.172155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:34.172822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:34.173265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:34.173681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:34.233276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:34.241078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d4fe3d2a-c176-495b-a211-2db2b7e6b463 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080794 Sep 01 08:39:34.241626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2267/4559] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:34 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:35.261922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:35.262508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:35.268347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:35.268816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:35.269240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:35.269911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:35.270378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:35.270794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:35.332871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:35.340981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38f220b4-c596-4dcf-b582-f2e82c378fb2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083151 Sep 01 08:39:35.341539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2293/4560] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:35 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:36.362697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:36.363338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:36.372213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:36.372981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:36.373681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:36.374857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:36.375599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:36.376187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:36.446300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:36.454763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a52e7079-8d96-4414-a02f-7cec02659b22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.096572 Sep 01 08:39:36.455338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2268/4561] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:36 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:37.476053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:37.476715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:37.483649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:37.484111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:37.484532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:37.485200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:37.485638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:37.486050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:37.545014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:37.552483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5d915be7-8341-4f29-87da-8cec2169650e tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080226 Sep 01 08:39:37.553028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2294/4562] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:37 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:39:38.572398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:38.573299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:38.577166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:39:38.577350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 (ip 10.222.0.43) !!! Sep 01 08:39:38.586398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:38.586900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:38.588179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:38.589103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:38.590439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:38.590876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:38.654811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:38.662737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9d8be2c1-5f69-471b-8a1e-3da2bfc3eac1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.094190 Sep 01 08:39:38.663291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2269/4563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:38 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:39.683838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:39.684472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:39.690759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:39.691234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:39.691662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:39.692372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:39.692817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:39.693231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:39.755433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:39.763038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6f3bb1de-34fc-4654-bc4b-cde127647423 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083298 Sep 01 08:39:39.763590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2295/4564] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:39 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:40.784884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:40.785491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:40.791438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:40.791915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:40.792866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:40.793624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:40.794105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:40.794528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:40.858084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:40.865646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c0de200f-5b6f-4d23-8de3-f75b376ca9e6 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084615 Sep 01 08:39:40.866197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2270/4565] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:40 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:41.886732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:41.887329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:41.893217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:41.893693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:41.894116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:41.894841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:41.895289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:41.895712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:41.956670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:41.965553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c3748783-650f-46e3-a7c7-cd1816bd0f52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082693 Sep 01 08:39:41.966123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2296/4566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:41 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:42.986366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:42.986976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:42.992820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:42.993288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:42.993712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:42.994406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:42.994850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:42.995399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:43.055144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:43.062898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6f9c0513-cd5a-4acd-80f2-b1f8dd1d4d5d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080360 Sep 01 08:39:43.063454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2271/4567] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:42 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:44.083466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:44.084074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:44.090623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:44.091109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:44.091541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:44.092221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:44.092672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:44.093096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:44.155705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:44.163346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-751a0d2d-5362-4164-95bc-f60e187bd8dd tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083662 Sep 01 08:39:44.163898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2297/4568] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:44 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:45.184928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:45.185488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:45.191293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:45.191765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:45.192191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:45.192861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:45.193303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:45.193717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:45.196195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:45.255571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:45.263732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a82b514-81f1-4bca-8bf4-9c9b8ca2bb63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082744 Sep 01 08:39:45.264273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2272/4569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:45 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:46.284016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:46.284643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:46.286563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:46.291744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:46.296237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:46.296673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:46.297356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:46.297803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:46.298265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:46.359875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:46.368187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3a6764bb-5c8d-46a8-ac99-61f7e56146f8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088034 Sep 01 08:39:46.368967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2298/4570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:46 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:47.389290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:47.389894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:47.391726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:47.397376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:47.397861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:47.398314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:47.399001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:47.399463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:47.399876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:47.460795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:47.468476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-63474fbb-3e2f-4670-a039-d5728bf6b5d8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083050 Sep 01 08:39:47.471335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2273/4571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:47 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:48.488767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:48.489366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:48.495423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:48.495888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:48.496312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:48.496981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:48.497415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:48.497826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:48.560280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:48.567971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-62d8a07d-4445-4408-95de-7be8cfdbf573 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082956 Sep 01 08:39:48.568527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2299/4572] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:48 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:49.588866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:49.590133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:49.596162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:49.596635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:49.597061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:49.597732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:49.598178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:49.598614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:49.658804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:49.666274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-604c45f5-948b-4702-8590-ba8e2bbe2351 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081429 Sep 01 08:39:49.666885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2274/4573] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:49 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:50.687572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:50.688305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:50.694436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:50.694923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:50.695356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:50.696050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:50.696500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:50.696920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:50.759783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:50.767364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b6ec443-1e55-48e0-afc7-642689a29f90 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083881 Sep 01 08:39:50.767930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2300/4574] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:50 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:51.788410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:51.789009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:51.795103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:51.795575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:51.796007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:51.796678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:51.797140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:51.797537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:51.857155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:51.864661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-17d4aa3a-6370-4f58-945d-7770d4502304 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080136 Sep 01 08:39:51.865214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2275/4575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:51 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:52.885087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:52.886420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:52.892493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:52.892971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:52.893403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:52.894082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:52.894557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:52.894986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:52.958058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:52.965690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ab122a60-bbbe-40e1-919c-300c560993b9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084424 Sep 01 08:39:52.966249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2301/4576] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:52 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:53.987055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:53.987657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:53.993457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:53.993926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:53.994382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:53.995681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:53.996121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:53.996537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:54.056008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:54.064401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5d5ed591-bbb9-4baf-a74f-55d836e956a4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081600 Sep 01 08:39:54.064969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2276/4577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:53 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:55.085478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:55.086074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:55.092490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:55.092970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:55.093389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:55.094058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:55.094522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:55.094942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:55.155493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:55.163023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38a62629-ad46-4513-a917-422433327890 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081324 Sep 01 08:39:55.163581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2302/4578] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:55 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:56.185455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:56.186019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:56.192059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:56.192534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:56.192961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:56.193630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:56.194068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:56.194506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:56.258076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:56.265727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15b92820-5262-4923-a0e6-b236cab92cbf tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084735 Sep 01 08:39:56.266371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2277/4579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:56 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:57.286139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:57.286791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:57.292749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:57.293228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:57.293664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:57.294381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:57.294834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:57.295258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:57.358515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:57.366183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f80a2af-de17-4efb-93e8-21181641eb22 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083823 Sep 01 08:39:57.366775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2303/4580] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:57 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:58.387378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:58.387982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:58.393983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:58.394492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:58.394926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:58.395605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:58.396082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:58.396476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:58.457282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:58.466146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0635b264-10c5-4fca-8205-d9595ced5683 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083127 Sep 01 08:39:58.466877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2278/4581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:58 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:39:59.486748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:39:59.487347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:39:59.493301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:59.493768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:59.494189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:59.495465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:39:59.495905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:39:59.496319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:39:59.498799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:59.555646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:39:59.563781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-40544186-f965-4a56-af54-bf255e594c31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080812 Sep 01 08:39:59.564346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2304/4582] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:39:59 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:00.584634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:00.585244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:00.591631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:00.592166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:00.592527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:00.593194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:00.593637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:00.594049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:00.655182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:00.662559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9cbaf55c-fbb8-480d-8880-c8462dabf1e9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081789 Sep 01 08:40:00.663110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2279/4583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:00 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:01.685007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:01.685607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:01.691762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:01.692225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:01.692652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:01.693340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:01.693788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:01.694208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:01.756731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:01.764262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7ce06db-64b1-434d-9144-f153c143dee1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084085 Sep 01 08:40:01.764809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2305/4584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:01 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:02.784446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:02.785059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:02.791181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:02.792102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:02.792601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:02.793297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:02.793750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:02.794176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:02.854034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:02.861686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-141f0527-bba2-461e-a50b-bab0f638c4f7 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081032 Sep 01 08:40:02.862244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2280/4585] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:02 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:03.881750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:03.882459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:03.888882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:03.889349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:03.889777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:03.890471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:03.890915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:03.891331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:03.951078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:03.958588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e8a1708f-3578-4443-9c84-f105c0a27b61 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080643 Sep 01 08:40:03.959144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2306/4586] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:03 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:04.978300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:04.978956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:04.985276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:04.985465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:04.985893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:04.986590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:04.987034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:04.987445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:05.046928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:05.054521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-16c00557-8a61-43c5-bc61-47798d7b2ad9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080008 Sep 01 08:40:05.055189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2281/4587] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:04 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:06.076131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:06.076768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:06.082749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:06.083229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:06.083662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:06.084359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:06.084807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:06.085230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:06.152503 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:06.160205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d6bc08e-42b2-42da-83c4-3a109218dd7c tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088176 Sep 01 08:40:06.160775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2307/4588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:06 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:07.181379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:07.182510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:07.188739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:07.189217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:07.189646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:07.190369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:07.190818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:07.191263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:07.254900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:07.262595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-04468c12-7579-49f4-aafe-487aebfcb860 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085107 Sep 01 08:40:07.263161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2282/4589] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:07 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:08.283121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:08.283742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:08.289700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:08.290182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:08.290653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:08.291881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:08.292339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:08.292852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:08.363665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:08.375585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3257966b-2099-4ac5-8ce9-d7653b481fa8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.096200 Sep 01 08:40:08.376180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2308/4590] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:08 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:09.396684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:09.397312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:09.404512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:09.404994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:09.405421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:09.406113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:09.406584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:09.407002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:09.475033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:09.483424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f7ca25c4-1108-46d9-bdaa-46ba2d93ea91 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.090771 Sep 01 08:40:09.483996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2283/4591] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:09 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:10.503986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:10.504585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:10.511231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:10.511703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:10.512162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:10.512852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:10.513296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:10.513711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:10.592575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:10.606766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a301cc46-501f-450a-84f1-3183de1b9e17 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.106145 Sep 01 08:40:10.607782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2309/4592] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:10 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:11.640750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:11.641364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:11.647552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:11.648025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:11.648450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:11.649132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:11.649581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:11.649997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:11.721191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:11.732864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6fb4b1f8-7fcc-4130-a49a-9c7e843ac15a tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.095819 Sep 01 08:40:11.733362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2284/4593] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:11 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:12.753834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:12.754473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:12.760459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:12.760937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:12.761370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:12.762047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:12.762549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:12.762970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:12.825390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:12.832975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-54ce1392-87f2-4f79-bc41-7cf35fc963c9 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082923 Sep 01 08:40:12.833524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2310/4594] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:12 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:13.853167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:13.853974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:13.860009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:13.860491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:13.860917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:13.861609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:13.862045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:13.862486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:13.926165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:13.934900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9ac90dd2-2638-4bfb-a0ba-5ace5123c586 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085662 Sep 01 08:40:13.935474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2285/4595] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:13 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:14.955529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:14.956154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:14.962568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:14.963059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:14.963493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:14.964200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:14.964644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:14.965066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:15.174427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:15.182537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4aeadf24-8c50-4566-81c9-0971678f7ab5 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.230620 Sep 01 08:40:15.183185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2311/4596] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:14 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:16.203848 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:16.204480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:16.210420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:16.210894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:16.211319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:16.211994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:16.212437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:16.212852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:16.215447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:16.272838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:16.280461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2e16a0c4-c841-4bfb-b343-1377262d6675 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080514 Sep 01 08:40:16.281013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2286/4597] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:16 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:17.301107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:17.301698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:17.303599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:17.308923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:17.309397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:17.309825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:17.310523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:17.310966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:17.311383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:17.372363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:17.379957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bce4b980-182a-403d-b656-2ed664ca0dd4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082663 Sep 01 08:40:17.380508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2312/4598] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:17 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:18.399795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:18.401214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:18.403223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:18.409032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:18.409514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:18.409944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:18.410670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:18.411125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:18.411549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:18.479494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:18.487790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a502643-cf53-4487-bafb-632aa696b7e2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.091666 Sep 01 08:40:18.488387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2287/4599] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:18 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:19.508831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:19.509434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:19.516036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:19.516517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:19.516950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:19.517634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:19.518081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:19.518555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:19.583571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:19.592138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-14e9a202-dc2a-40bf-b2d5-c5e53a2d45f1 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.087050 Sep 01 08:40:19.592716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2313/4600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:19 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:20.612799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:20.613401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:20.619183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:20.620551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:20.621139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:20.621949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:20.622457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:20.622955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:20.683906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:20.692098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cbc897a0-d025-4f2f-b5a3-a7631c430f63 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083136 Sep 01 08:40:20.692654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2288/4601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:20 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:21.712751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:21.713983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:21.720046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:21.720517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:21.720945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:21.721667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:21.722057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:21.722505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:21.783175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:21.792143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d049405-b5bf-4c72-a55c-f9a5d09b0d24 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082793 Sep 01 08:40:21.792718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2314/4602] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:21 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:22.813388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:22.813981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:22.820029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:22.820508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:22.820940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:22.821619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:22.822358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:22.823011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:22.885988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:22.893608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bb74adf4-a96f-430d-9323-bb875c00e2c2 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084049 Sep 01 08:40:22.894175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2289/4603] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:22 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:23.914514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:23.915115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:23.921641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:23.922117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:23.922582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:23.923262 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:23.923709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:23.924131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:23.988529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:23.996104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-341ded6b-39ca-4ecc-972d-30afec22bc41 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.085431 Sep 01 08:40:23.996661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2315/4604] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:23 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:25.017266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:25.018014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:25.024508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:25.025000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:25.025444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:25.026149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:25.026628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:25.027053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:25.096532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:25.107145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9a64f77e-6f07-4f08-8f83-f27ddf7e9b52 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.093998 Sep 01 08:40:25.107737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2290/4605] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:25 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:26.127546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:26.128127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:26.134106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:26.134617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:26.135761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:26.136505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:26.137049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:26.137471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:26.199346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:26.207091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dc7b03a0-cf10-41c3-aaf3-cea0677ee87f tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083449 Sep 01 08:40:26.207653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2316/4606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:26 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:40:27.227932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:27.228535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:27.234756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:27.235248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:27.235682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:27.236377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:27.236822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:27.237244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:27.301230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:27.314599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-56203e5d-1f20-4148-9674-831c3399646d tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.090416 Sep 01 08:40:27.315177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2291/4607] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:27 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:28.335754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:28.336358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:28.342209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:28.342710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:28.343137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:28.343811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:28.344255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:28.344673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:28.406761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:28.414692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75ce020c-24d4-419b-bc13-003fa6de84af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082693 Sep 01 08:40:28.415267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2317/4608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:28 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:29.436219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:29.436872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:29.443014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:29.443496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:29.443931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:29.444628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:29.445077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:29.445500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:29.505639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:29.513689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-90b40eb6-dbb3-4c17-a878-c7919dfe0749 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082212 Sep 01 08:40:29.514290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2292/4609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:29 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:30.535590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:30.536212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:30.542136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:30.542700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:30.543148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:30.543818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:30.544269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:30.544694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:30.547234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:30.605568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:30.613798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6392cd07-1d4c-4d01-b87e-ec9ce5f42eb3 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.081950 Sep 01 08:40:30.614396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2318/4610] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:30 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:31.635345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:31.636580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:31.642826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:31.643303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:31.643724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:31.644398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:31.644867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:31.645297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:31.706483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:31.714826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-215f3f71-e674-4fbd-8a52-23e08fbbd963 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082525 Sep 01 08:40:31.715408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2293/4611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:31 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:40:32.735573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:32.736160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:32.742669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:32.743182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:32.743640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:32.744331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:32.744806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:32.745226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:32.812216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:32.820175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-78f1be80-26f7-4283-9d52-8b27194cbac8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088541 Sep 01 08:40:32.820697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2319/4612] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:32 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:33.841385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:33.842000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:33.847974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:33.848441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:33.848868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:33.849536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:33.849971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:33.850417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:33.912703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:33.921298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-af333532-f85c-41ac-a1b3-95cbef289977 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.084161 Sep 01 08:40:33.921888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2294/4613] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:33 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:34.942205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:34.942897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:34.949909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:34.950416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:34.950848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:34.951560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:34.951981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:34.952395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:35.018751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:35.026675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b31aac9-7644-4911-80dc-22cb4150b3b4 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.088217 Sep 01 08:40:35.027361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2320/4614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:34 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:36.047056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:36.047657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:36.053488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:36.053959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:36.054414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:36.055082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:36.055524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:36.055938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:36.115397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:36.123168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-544d2e47-b161-48b7-89dd-244040d72061 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.079974 Sep 01 08:40:36.123738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2295/4615] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:36 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:37.144458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:37.145059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:37.150918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:37.151983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:37.152506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:37.153183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:37.153621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:37.154040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:37.216740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:37.224538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b054168-606f-48ab-8430-6d7b973a60a8 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083862 Sep 01 08:40:37.225106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2321/4616] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:37 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:38.246113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:38.246855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:38.252757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:38.253226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:38.253651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:38.254350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:38.254803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:38.255213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:38.315897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:38.324171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6f06c96a-061b-4fb3-9dc0-5f385d749d68 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.082355 Sep 01 08:40:38.324741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2296/4617] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:38 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:39.344544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:39.345152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:39.351103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:39.351574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:39.352002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:39.352708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:39.353150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:39.353562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:39.413327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:39.421447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8b6c1ab3-ca9b-4bf6-9d2d-9bc35dcdad47 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.080713 Sep 01 08:40:39.422010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2322/4618] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:39 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:40.441671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:40.442277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:40.449354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:40.449856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:40.450308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:40.451006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:40.451456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:40.451877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:40.517972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:40.525781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4ab2f5f4-8365-47b8-b497-d7074ae43e31 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.087955 Sep 01 08:40:40.527148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2297/4619] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:40 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:41.547757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:41.548403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:41.554496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:41.554975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:41.555403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:41.556088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:41.556530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:41.556955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:41.623410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:41.633060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d02a6add-8725-412b-afde-d6070ad3a4af tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.089198 Sep 01 08:40:41.633644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2323/4620] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:41 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:42.653181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:42.653778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:42.659831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:42.660308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:42.660745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:42.661432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:42.661882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:42.662333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:42.724202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd2c619e9fc436ea01a1200bc46b60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8088d87969e46a2b2cc69dd7297ae14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:40:42.733449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b44ad8a4-6b9b-4dcd-ae92-a41cc6dbf97b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 200 len: 1245 microversion: 2.1 time: 0.083881 Sep 01 08:40:42.734161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2298/4621] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:42 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:42.755091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:42.755713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:42.761951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:42.762600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:42.763031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:42.763714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:42.764156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:42.764566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:42.790287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:40:42.801003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:42.801477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:42.801903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:42.816269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'flavor' on Instance uuid 827a9387-98ea-478b-9e53-b7a5df2a2145 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:40:42.828794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'system_metadata' on Instance uuid 827a9387-98ea-478b-9e53-b7a5df2a2145 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:40:42.846634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lazy-loading 'metadata' on Instance uuid 827a9387-98ea-478b-9e53-b7a5df2a2145 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:40:43.007327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [477888b9-c9e8-4704-9e2d-259b4ada2d22] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 08:40:44.015995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [477888b9-c9e8-4704-9e2d-259b4ada2d22] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 55052. Sep 01 08:40:44.186127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Deleted allocations for instance 827a9387-98ea-478b-9e53-b7a5df2a2145 Sep 01 08:40:44.204735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0327c776-5ec7-4214-8051-8d8f80b31c4b tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "DELETE /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 204 len: 0 microversion: 2.1 time: 1.453882 Sep 01 08:40:44.205489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2324/4622] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:40:42 2022] DELETE /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 0 bytes in 1455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:40:44.217515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:44.218470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] [instance: 827a9387-98ea-478b-9e53-b7a5df2a2145] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:40:44.228761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:44.230130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:44.230951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:44.232189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:40:44.232972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:40:44.233615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:40:44.255026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] HTTP exception thrown: Instance 827a9387-98ea-478b-9e53-b7a5df2a2145 could not be found. Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Request method failure captured: Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 HTTP/1.1 Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEGvESDAEazsCEeCNcxG06A9K3it5r5eEzs0PvD93A7hjcqTHrlXbhK0f6m8Pd4m2YKHFzAfnzyGoSxRwwwSnsuTaLrGfBnNxX4I0AbMKiVHhtmL42A-Xvraj7YgIJiKoEJYG4Nr2y6nKk0P2U3418Jhl7f3hMOzSeqXyE6zXI_9tu5U Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: e8088d87969e46a2b2cc69dd7297ae14 Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:40:44.256559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e8088d87969e46a2b2cc69dd7297ae14", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e8088d87969e46a2b2cc69dd7297ae14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: e8088d87969e46a2b2cc69dd7297ae14 Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2002778612 Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-AttachVolumeNegativeTest-2002778612-project Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: ccd2c619e9fc436ea01a1200bc46b60f Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-AttachVolumeNegativeTest-2002778612-project Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance 827a9387-98ea-478b-9e53-b7a5df2a2145 could not be found. Sep 01 08:40:44.259173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '827a9387-98ea-478b-9e53-b7a5df2a2145'} Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 827a9387-98ea-478b-9e53-b7a5df2a2145 could not be found. Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:40:44.260737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827a9387-98ea-478b-9e53-b7a5df2a2145 could not be found. Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827a9387-98ea-478b-9e53-b7a5df2a2145 could not be found. Sep 01 08:40:44.263470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:40:44.265771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Returning 404 to user: Instance 827a9387-98ea-478b-9e53-b7a5df2a2145 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:40:44.265771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fbaf985e-a61a-4860-ba78-102c84052951 tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145" status: 404 len: 111 microversion: 2.1 time: 0.047718 Sep 01 08:40:44.265771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2299/4623] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:40:44 2022] GET /compute/v2.1/servers/827a9387-98ea-478b-9e53-b7a5df2a2145 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:40:44.267905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6b1b5756-5019-4a0f-b0c6-9e22e054a9aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] Calling method '.version_select at 0x7f2ac29afb80>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:44.289002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6b1b5756-5019-4a0f-b0c6-9e22e054a9aa tempest-AttachVolumeNegativeTest-2002778612 tempest-AttachVolumeNegativeTest-2002778612-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343239464" status: 202 len: 0 microversion: 2.1 time: 0.024642 Sep 01 08:40:44.290077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2325/4624] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Sep 1 08:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343239464 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 08:40:50.912338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aea228fb-9731-4330-9f93-f725979328be tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf0b41f0>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:51.080375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aea228fb-9731-4330-9f93-f725979328be tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/b535a00d-0c3f-49a5-a4fe-ae9f0dcbfdf0" status: 200 len: 351 microversion: 2.1 time: 0.171510 Sep 01 08:40:51.081400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2300/4625] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:40:50 2022] GET /compute/v2.1/os-volumes/b535a00d-0c3f-49a5-a4fe-ae9f0dcbfdf0 => generated 351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:40:52.435020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-90833538-b823-4c15-9efd-4157d00d88d5 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf7f31f0>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:52.535227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-90833538-b823-4c15-9efd-4157d00d88d5 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3f31cb9c-81dc-463d-8174-0c8240b49318" status: 200 len: 351 microversion: 2.1 time: 0.104564 Sep 01 08:40:52.535834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2326/4626] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:40:52 2022] GET /compute/v2.1/os-volumes/3f31cb9c-81dc-463d-8174-0c8240b49318 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:40:53.889106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7372a430-eeb6-4cc4-a309-4072ef7ceb40 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf0b4550>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:53.937349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7372a430-eeb6-4cc4-a309-4072ef7ceb40 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5b2b47e7-d828-4a71-ab11-1e117443ab5e" status: 200 len: 351 microversion: 2.1 time: 0.052700 Sep 01 08:40:53.937921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2301/4627] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Sep 1 08:40:53 2022] GET /compute/v2.1/os-volumes/5b2b47e7-d828-4a71-ab11-1e117443ab5e => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:40:53.951511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bedb878b-7160-4a90-805e-330036180686 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf721310>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.036807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bedb878b-7160-4a90-805e-330036180686 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.090153 Sep 01 08:40:54.037385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2327/4628] 10.222.0.43 () {58 vars in 1134 bytes} [Thu Sep 1 08:40:53 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:54.052974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-27b940d5-f11d-47f7-84f0-69836c569229 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2ac29aad30>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.142837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-27b940d5-f11d-47f7-84f0-69836c569229 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093486 Sep 01 08:40:54.143400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2302/4629] 10.222.0.43 () {58 vars in 1149 bytes} [Thu Sep 1 08:40:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:40:54.154145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:54.157989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd5ece77-213a-4c8e-81d5-aeee7258418f tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf0f4790>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.247208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd5ece77-213a-4c8e-81d5-aeee7258418f tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.093694 Sep 01 08:40:54.247774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2328/4630] 10.222.0.43 () {58 vars in 1134 bytes} [Thu Sep 1 08:40:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:40:54.257367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=25 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:54.258100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=79 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:54.262938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1461ba25-6259-4a7b-b738-b220e681bf01 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf0b4670>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.350387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1461ba25-6259-4a7b-b738-b220e681bf01 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093607 Sep 01 08:40:54.350961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2303/4631] 10.222.0.43 () {58 vars in 1167 bytes} [Thu Sep 1 08:40:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:40:54.361064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:54.365024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c986032f-becc-4f18-aea3-9b03c52462f7 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf721310>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.455222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c986032f-becc-4f18-aea3-9b03c52462f7 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094781 Sep 01 08:40:54.455803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2329/4632] 10.222.0.43 () {58 vars in 1170 bytes} [Thu Sep 1 08:40:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:40:54.468919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9352d23b-0c79-412a-9a81-79932d3ff76f tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2ac0391b80>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.556202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9352d23b-0c79-412a-9a81-79932d3ff76f tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.090986 Sep 01 08:40:54.556779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2304/4633] 10.222.0.43 () {58 vars in 1155 bytes} [Thu Sep 1 08:40:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:40:54.571109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1823b4b5-7b5d-4cf0-a605-95eb41758e82 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2abf0b5160>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.659002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1823b4b5-7b5d-4cf0-a605-95eb41758e82 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092261 Sep 01 08:40:54.659559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2330/4634] 10.222.0.43 () {58 vars in 1188 bytes} [Thu Sep 1 08:40:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:40:54.672644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f695789-1d40-4111-a438-0daa5ec23538 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] Calling method '.version_select at 0x7f2ac29aa820>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:40:54.758610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f695789-1d40-4111-a438-0daa5ec23538 tempest-VolumesTestJSON-137095582 tempest-VolumesTestJSON-137095582-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089656 Sep 01 08:40:54.759178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2305/4635] 10.222.0.43 () {58 vars in 1155 bytes} [Thu Sep 1 08:40:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:05.964935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1298011906", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "networks": [{"uuid": "46a9c68a-8627-454e-978d-23ace008964c"}]}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:41:06.039854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.network.neutron [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] validate_networks() for [('46a9c68a-8627-454e-978d-23ace008964c', None, None, None, None, None)] {{(pid=120753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:41:06.779323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Flavor limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:41:06.780111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Image limits 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:41:06.780976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Flavor pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:41:06.781709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Image pref 0:0:0 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:41:06.782484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.virt.hardware [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:41:06.797722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:06.798634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:06.799448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:06.800845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:06.801622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:06.802475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:06.835577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Getting quotas for project 25b100830711488eaccc36e6452e393b. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:41:06.843209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Getting quotas for user b3b80c8db57f466ab4260d2a2774d96c and project 25b100830711488eaccc36e6452e393b. Resources: {'ram', 'cores', 'instances'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:41:06.861928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Going to run 1 instances... {{(pid=120753) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:41:06.865537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:41:06.924938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [6ae6f4f1-6892-4379-9cbf-67491e678ec3] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 08:41:07.934237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [6ae6f4f1-6892-4379-9cbf-67491e678ec3] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 55344. Sep 01 08:41:07.938682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d54e7ba6-eaa0-46f1-8e3b-d681d9a89574 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.981707 Sep 01 08:41:07.940012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2331/4636] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:41:07.960389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-997c4d27-74fc-41db-b24e-19efff24e877 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:07.961340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-997c4d27-74fc-41db-b24e-19efff24e877 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:08.034200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-997c4d27-74fc-41db-b24e-19efff24e877 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:08.041283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-997c4d27-74fc-41db-b24e-19efff24e877 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1214 microversion: 2.1 time: 0.088334 Sep 01 08:41:08.041865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2306/4637] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:07 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:09.069171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:09.069817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:09.077557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:09.078237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:09.078621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:09.079431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:09.079661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:09.080198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:09.165232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:09.174109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a88b03c-504b-49a1-8d77-2e90b8d8b58a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.108902 Sep 01 08:41:09.174801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2332/4638] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:09 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:10.200330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:10.201979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:10.214748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:10.215576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:10.216322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:10.217703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:10.218438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:10.219104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:10.296649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:10.305873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09fd0ed7-68f1-4fa5-b56d-71dc9f174ce8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.113347 Sep 01 08:41:10.306536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2307/4639] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:10 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:11.332498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:11.333151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:11.340173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:11.340669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:11.341096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:11.341802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:11.342251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:11.342693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:11.408888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:11.417777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9ea3bd7-6331-4f10-944d-7c01101d454f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.088982 Sep 01 08:41:11.418359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2333/4640] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:11 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:41:12.444825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:12.446373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:12.457163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:12.458556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:12.459802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:12.461666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:12.462543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:12.464150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:12.568252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:12.581625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-535cd390-4558-47b1-8d7c-7a330db38358 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.145887 Sep 01 08:41:12.582314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2308/4641] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:12 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:13.605411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:13.606219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:13.612717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:13.613207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:13.613648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:13.614459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:13.614919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:13.615379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:13.690814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:13.705547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0bce51b-6bed-4fc6-b5d5-bf92360ee6f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.104298 Sep 01 08:41:13.706712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2334/4642] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:13 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:41:14.737695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:14.738509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:14.744694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:14.745173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:14.745606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:14.746331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:14.746782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:14.747199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:14.810108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:14.818206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5cfb8844-cf34-4784-8e0f-2ca143f90fee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085452 Sep 01 08:41:14.818837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2309/4643] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:14 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:41:15.840242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:15.840862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:15.846794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:15.847266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:15.847716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:15.848376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:15.848817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:15.849225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:15.913758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:15.922450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93cbb491-4b4a-458f-8d8e-ee21cf9a56b3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086915 Sep 01 08:41:15.923033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2335/4644] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:15 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:16.943984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:16.944586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:16.952921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:16.953411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:16.953845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:16.954579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:16.955031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:16.955450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:17.023988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:17.032544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1ee89190-0289-4cc2-8add-0a189be6b258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.092339 Sep 01 08:41:17.033113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2310/4645] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:16 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:18.053628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:18.054231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:18.056148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:18.056808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=6 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:18.063067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:18.063556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:18.063988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:18.064680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:18.065130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:18.065550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:18.128580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:18.138816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a054a7b-e85e-4ae0-b6ec-9afb3bdc1918 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.088684 Sep 01 08:41:18.139442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2336/4646] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:18 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:41:19.160726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:19.161363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:19.163484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:19.164504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:41:19.164757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:41:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 (ip 10.222.0.43) !!! Sep 01 08:41:19.173643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:19.174121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:19.174594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:19.175292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:19.175733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:19.176155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:19.242609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:19.250911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7e4e9ea0-7091-4f68-9027-acddbb307c12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.094099 Sep 01 08:41:19.251494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2311/4647] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:19 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:20.271865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:20.272409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:20.278635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:20.279142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:20.279564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:20.280245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:20.280687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:20.281101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:20.343585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:20.352443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41b8b038-5e7d-445d-a8ba-c27514b8b89d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084620 Sep 01 08:41:20.353011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2337/4648] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:20 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:21.374212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:21.374905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:21.381030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:21.381503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:21.381931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:21.382754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:21.383253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:21.383692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:21.449949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:21.458170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-79b42ab9-2dbf-43af-bc41-7634d48c6e9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.087829 Sep 01 08:41:21.458822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2312/4649] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:21 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:22.480578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:22.481263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:22.487980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:22.488464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:22.488895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:22.489588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:22.490039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:22.490506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:22.560590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:22.568309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-72ce3409-d2e2-41b9-9fa4-84e668d9ab83 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.092643 Sep 01 08:41:22.568876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2338/4650] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:22 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:23.590467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:23.591109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:23.597183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:23.597666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:23.598100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:23.598855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:23.599305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:23.599729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:23.669536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:23.677436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3bfd0fdb-902f-48ee-879c-590bcc36140d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.091477 Sep 01 08:41:23.678018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2313/4651] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:23 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:41:24.698886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:24.699492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:24.705395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:24.705874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:24.706324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:24.707004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:24.707458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:24.707879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:24.770993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:24.779900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4f559be3-8deb-43e4-8aef-2abf37be980c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085982 Sep 01 08:41:24.780493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2339/4652] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:24 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:25.801021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:25.801737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:25.808477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:25.808956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:25.809387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:25.810069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:25.810540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:25.810962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:25.879941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:25.888868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5aee55df-f2ac-4cbc-8c5e-3b5ef9305581 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.091658 Sep 01 08:41:25.889439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2314/4653] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:25 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:26.910174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:26.910770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:26.917399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:26.917887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:26.918326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:26.919015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:26.919460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:26.919878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:26.982923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:26.990686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-60e190ad-cd54-4f42-888c-2a555be9cff1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084344 Sep 01 08:41:26.991245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2340/4654] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:26 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:28.012514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:28.013122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:28.019113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:28.019581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:28.020006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:28.020679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:28.021125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:28.021539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:28.083920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:28.092300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15ad502a-f40c-4750-a77d-bfadf0a758ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084258 Sep 01 08:41:28.092862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2315/4655] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:28 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:29.112962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:29.113571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:29.120926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:29.121457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:29.121921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:29.122698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:29.123151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:29.123573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:29.194677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:29.203077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b309fa9-16cf-49dc-b052-7a432f26365b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.093938 Sep 01 08:41:29.203641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2341/4656] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:29 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:41:30.224149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:30.224750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:30.231046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:30.231521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:30.231950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:30.232634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:30.233076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:30.233489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:30.298363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:30.306639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a215bd39-891f-4f1d-89c8-92f4df4bfe1e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085709 Sep 01 08:41:30.307250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2316/4657] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:30 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:31.328059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:31.328663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:31.334535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:31.335007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:31.335432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:31.336097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:31.336537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:31.336948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:31.398572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:31.408494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d82a39d-0fe7-461c-a5be-845df33b3ce9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084256 Sep 01 08:41:31.409073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2342/4658] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:31 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:32.429480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:32.430127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:32.436191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:32.436674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:32.437107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:32.437794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:32.438244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:32.438687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:32.504174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:32.512563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2612e97f-ef74-4198-80d2-40babf4f284f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086796 Sep 01 08:41:32.513140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2317/4659] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:32 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:33.533099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:33.533726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:33.539716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:33.540194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:33.540645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:33.541308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:33.542530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:33.543133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:33.605847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:33.613566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2cc75d39-2b8f-4ca2-8815-6a8a95f93dbc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084216 Sep 01 08:41:33.614138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2343/4660] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:33 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:34.634015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:34.634654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:34.641199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:34.641675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:34.642103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:34.642802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:34.643248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:34.643663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:34.707713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:34.716397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c754023-0175-41c5-9eed-f844e6b8055e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086093 Sep 01 08:41:34.716968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2318/4661] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:34 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:35.736872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:35.737396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:35.743392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:35.743874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:35.744306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:35.744996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:35.745449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:35.745860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:35.810449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:35.818255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-230d0d04-c721-4557-8960-6cc1d6241ba9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085190 Sep 01 08:41:35.818852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2344/4662] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:35 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:36.838941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:36.839567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:36.845855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:36.846366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:36.846800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:36.847484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:36.847967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:36.848386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:36.910168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:36.918967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7458ef36-4e3b-4048-aed9-4aef217467ea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083815 Sep 01 08:41:36.919547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2319/4663] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:36 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:37.939484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:37.940088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:37.941932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:37.947465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:37.948755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:37.949220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:37.949953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:37.950436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:37.950859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:37.954926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=81 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:38.014828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:38.022434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-22fd05f6-f415-478e-a8ba-9a2e07948139 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086699 Sep 01 08:41:38.023004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2345/4664] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:37 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:39.044816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:39.045423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:39.047272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=31 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:39.052705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:39.053190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:39.053625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:39.054504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:39.055023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:39.055182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:39.058991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=79 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:39.122372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:39.130080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3f18c152-322b-4389-9423-3407fc2c2dab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.089640 Sep 01 08:41:39.130852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2320/4665] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:39 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:40.150699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:40.151491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:40.157555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:40.158028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:40.158486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:40.159170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:40.159617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:40.160032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:40.224836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:40.238322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aab605fd-8454-4a80-bdb9-b89671f524cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.091362 Sep 01 08:41:40.238909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2346/4666] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:40 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:41.259440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:41.260045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:41.266096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:41.266601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:41.267032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:41.267705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:41.268150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:41.268571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:41.328458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:41.336159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-10738336-088e-4ac2-a9d5-7d2e618f507f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080482 Sep 01 08:41:41.336731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2321/4667] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:41 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:42.356150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:42.356796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:42.362723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:42.363197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:42.363621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:42.364302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:42.364743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:42.365185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:42.426890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:42.435164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b49826c-c6a7-4d6f-8a3e-6fc7037bef19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082796 Sep 01 08:41:42.435725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2347/4668] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:42 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:43.456768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:43.457280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:43.463606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:43.464076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:43.464498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:43.465169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:43.465614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:43.466029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:43.529911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:43.537615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8afa0f1d-95ee-4d6c-9223-511bfaedea94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084908 Sep 01 08:41:43.538188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2322/4669] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:43 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:44.559473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:44.560073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:44.565970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:44.566477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:44.566903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:44.567568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:44.568010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:44.568422 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:44.630082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:44.638696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d69d5207-e6c1-4fcf-afb4-1e133e05646a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083494 Sep 01 08:41:44.639263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2348/4670] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:44 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:45.658886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:45.659493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:45.665393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:45.665869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:45.666852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:45.667694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:45.668147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:45.668567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:45.730273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:45.737960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a61a015-6011-4dc5-a257-8c809a2fed14 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082882 Sep 01 08:41:45.738556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2323/4671] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:45 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:46.758133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:46.758711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:46.765122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:46.765592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:46.766015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:46.766939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:46.767378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:46.767789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:46.829432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:46.837154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cc63e490-f88b-4b81-ac1e-3d0466db1c01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082908 Sep 01 08:41:46.837820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2349/4672] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:46 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:47.857552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:47.858177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:47.864155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:47.864628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:47.865054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:47.865723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:47.866167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:47.866611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:47.930029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:47.938155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-285cb523-ee0b-4d18-8579-1e1c3e51c509 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084984 Sep 01 08:41:47.939236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2324/4673] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:47 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:48.959834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:48.960434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:48.966532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:48.967003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:48.967425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:48.968093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:48.968534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:48.968946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:49.031173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:49.038764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd88e5eb-a48b-4dff-bb40-0fb3b6338307 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082718 Sep 01 08:41:49.039331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2350/4674] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:48 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:50.060223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:50.060831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:50.066759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:50.067180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:50.067607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:50.068282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:50.068731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:50.069183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:50.131571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:50.140395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-32ab24f6-c3e2-4543-ae31-f11eaf4c303e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083994 Sep 01 08:41:50.140983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2325/4675] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:50 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:51.160586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:51.161182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:51.167278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:51.167748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:51.168173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:51.168842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:51.169284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:51.169705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:51.229558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:51.237223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-090a9004-c31c-46d2-9141-7b92702a59b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080463 Sep 01 08:41:51.237774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2351/4676] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:51 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:52.257480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:52.258092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:52.264235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:52.264711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:52.265149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:52.265826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:52.266284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:52.266715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:52.329820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:52.337538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-85dc7dde-4163-4ead-8fba-e3eb027c9377 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083859 Sep 01 08:41:52.338644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2326/4677] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:52 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:53.358489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:53.359095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:53.364972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:53.365447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:53.365881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:53.366590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:53.367035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:53.367456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:53.427834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:53.435631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2a81698-646a-4823-bb2b-fbc4be3bed23 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080941 Sep 01 08:41:53.436209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2352/4678] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:53 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:54.456743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:54.457344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:54.463724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:54.464353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:54.464783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:54.465460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:54.465905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:54.466344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:54.526228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:54.533920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-69e0c521-cc51-4d70-98c8-203e9fae5038 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080976 Sep 01 08:41:54.534533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2327/4679] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:54 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:55.554442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:55.555043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:55.561342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:55.561815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:55.562248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:55.562955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:55.563400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:55.563821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:55.625779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:55.634673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b4d3fcd-a5d7-4670-ac3b-a92cb5d897c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083948 Sep 01 08:41:55.635244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2353/4680] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:55 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:56.656216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:56.656808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:56.662969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:56.663444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:56.663871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:56.664547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:56.664994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:56.665406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:56.732370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:56.740138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-660b6def-38a1-49a2-a43b-8eb87222fd7d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.088281 Sep 01 08:41:56.740709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2328/4681] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:56 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:57.760629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:57.761150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:57.767306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:57.767781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:57.768237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:57.768919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:57.769364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:57.769783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:57.829995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:57.840904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-622b5b6a-a36a-4563-9b09-602a76044b52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084014 Sep 01 08:41:57.841703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2354/4682] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:57 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:58.861590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:58.862189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:58.868229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:58.868704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:58.869131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:58.869803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:58.870245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:58.870694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:58.931818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:41:58.939872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-726a4af3-ebcc-442c-af9b-57ae081b037b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082041 Sep 01 08:41:58.940452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2329/4683] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:58 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:41:59.960849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:41:59.961458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:41:59.967487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:59.967992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:59.968428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:41:59.969103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:41:59.969581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:41:59.970011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:00.029057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:00.036642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1c48f2d3-7fe2-4fa1-8cd7-f7dfe94bf45a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079597 Sep 01 08:42:00.037209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2355/4684] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:41:59 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:01.059370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:01.059977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:01.065907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:01.066414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:01.066857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:01.067525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:01.068445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:01.068445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:01.131941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:01.140652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b67830f0-6f7b-4478-a297-ec04c2813b00 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085240 Sep 01 08:42:01.141242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2330/4685] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:01 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:02.161279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:02.161879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:02.167883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:02.168358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:02.168781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:02.169574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:02.170017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:02.170457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:02.230474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:02.246953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-890ea919-f391-4134-a68b-2fc8aad61e52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.089403 Sep 01 08:42:02.247608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2356/4686] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:02 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:03.267549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:03.268073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:03.274195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:03.274706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:03.275142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:03.275824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:03.276274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:03.276695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:03.336030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:03.343874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7dd374c0-fb72-4a37-a553-101ce8a649e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080794 Sep 01 08:42:03.344448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2331/4687] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:03 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:04.363304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:04.363908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:04.369746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:04.370224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:04.370682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:04.371356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:04.371802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:04.372219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:04.430961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:04.438908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-093ac08d-36e0-4b34-9208-ac2d365ee5ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079360 Sep 01 08:42:04.439490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2357/4688] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:04 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:05.460608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:05.461273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:05.467756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:05.468224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:05.468648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:05.469328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:05.469771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:05.470183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:05.542473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:05.551032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-568d243b-9498-4944-ad6c-e286d4836c16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.094204 Sep 01 08:42:05.551602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2332/4689] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:05 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:06.573216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:06.573885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:06.580720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:06.581204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:06.581640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:06.582364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:06.582816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:06.583232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:06.643406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:06.651054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e81f518-93a3-4479-bee0-9599ae110e8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082871 Sep 01 08:42:06.651641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2358/4690] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:06 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:07.672529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:07.673128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:07.679056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:07.679533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:07.679960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:07.680636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:07.681085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:07.681505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:07.744172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:07.752227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9c0c0c0e-8202-441c-a5aa-e8dff6e034ca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084101 Sep 01 08:42:07.752787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2333/4691] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:07 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:08.772530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:08.773054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:08.775214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:08.781632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:08.782184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:08.782675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:08.783364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:08.783815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:08.784545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:08.787570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:08.849473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:08.858586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3a030653-7072-4fb2-bf59-6886330f4f97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.090041 Sep 01 08:42:08.859239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2359/4692] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:08 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:09.879863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:09.880457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:09.882287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:09.887903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:09.888916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:09.889514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:09.890197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:09.890669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:09.891086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:09.893610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:09.956732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:09.964782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d16d83ca-c715-4607-9116-08e73502e56f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.088726 Sep 01 08:42:09.965376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2334/4693] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:09 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:10.985579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:10.986184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:10.992214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:10.992684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:10.993117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:10.993787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:10.994222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:10.994659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:11.055251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:11.063624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-63b5699b-d15a-4056-9f84-b737ab695af4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081918 Sep 01 08:42:11.064223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2360/4694] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:10 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:12.089628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:12.090232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:12.096387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:12.096861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:12.097292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:12.097967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:12.098439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:12.098859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:12.160226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:12.168419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9b1f6213-6a26-4687-825e-64ecd5301013 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082520 Sep 01 08:42:12.169003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2335/4695] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:12 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:13.190339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:13.190986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:13.197478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:13.197956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:13.198412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:13.199108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:13.199561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:13.199987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:13.263938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:13.277532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-423592b4-29d3-4d09-a57f-ca87f2c1355f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.091473 Sep 01 08:42:13.278646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2361/4696] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:13 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:14.300046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:14.300645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:14.306816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:14.307285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:14.307709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:14.308377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:14.308823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:14.309231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:14.373245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:14.381791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-605b8c47-e802-48a0-a65c-bb4238ab1ee0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085737 Sep 01 08:42:14.382383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2336/4697] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:14 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:15.402493 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:15.403014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:15.408900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:15.409370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:15.409793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:15.410489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:15.410933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:15.411349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:15.470784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:15.478481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9ad46946-c963-43de-9dc9-56bbcb88bd3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079774 Sep 01 08:42:15.479050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2362/4698] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:15 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:16.498599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:16.499778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:16.505607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:16.506073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:16.506531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:16.507201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:16.507641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:16.508061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:16.567949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:16.576308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2919d0d3-a824-4546-9c52-2a5ffc5ac4b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081387 Sep 01 08:42:16.577580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2337/4699] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:16 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:17.596965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:17.597630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:17.603852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:17.604331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:17.604758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:17.605447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:17.605887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:17.606329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:17.669982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:17.677982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b18f8a1-4acb-4f1a-be7b-38dde32a6eeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084913 Sep 01 08:42:17.678590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2363/4700] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:17 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:18.698714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:18.699319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:18.706355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:18.706757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:18.707108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:18.707795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:18.708245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:18.708664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:18.774137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:18.783153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-961def6a-c807-4e1d-bd19-2686c08fe678 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.088462 Sep 01 08:42:18.783737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2338/4701] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:18 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:19.803020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:19.803630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:19.809866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:19.810385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:19.810814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:19.812030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:19.812523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:19.812946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:19.875600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:19.885776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-91c3885a-6a4c-4d8b-bfbd-5fbc9f7aef51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086496 Sep 01 08:42:19.886395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2364/4702] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:19 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:20.907526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:20.908164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:20.914202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:20.914709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:20.915135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:20.915814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:20.916255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:20.916670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:20.979449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:20.987488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eadb2125-a153-478b-b554-e3a234d3e60b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083929 Sep 01 08:42:20.988050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2339/4703] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:20 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:22.008932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:22.009543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:22.015847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:22.016441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:22.016772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:22.017463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:22.017910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:22.018357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:22.080286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:22.087960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1cbd6f9-5a9a-43a2-8759-2d266e54a408 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083062 Sep 01 08:42:22.088561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2365/4704] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:22 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:23.111131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:23.111780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:23.118143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:23.118573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:23.119044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:23.119741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:23.120185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:23.120599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:23.187061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:23.195599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8bcf1153-57b5-4080-bd2e-6a9bff1f13f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.088678 Sep 01 08:42:23.196226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2340/4705] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:23 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:24.216837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:24.217438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:24.223643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:24.224115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:24.224541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:24.225220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:24.225655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:24.226066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:24.289244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:24.297020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95998e67-8064-4638-8623-75ca604742b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083983 Sep 01 08:42:24.297588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2366/4706] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:24 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:25.317778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:25.318450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:25.324726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:25.325192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:25.325619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:25.326318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:25.326768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:25.327184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:25.388002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:25.395844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-35e179dd-efff-41c1-8c21-43a81a3a5c96 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081860 Sep 01 08:42:25.396429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2341/4707] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:25 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:26.416517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:26.417122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:26.423380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:26.423855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:26.424288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:26.424969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:26.425418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:26.425837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:26.487538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:26.495144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7848c80-c6e2-48cd-9420-ee72972f3d88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082415 Sep 01 08:42:26.495638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2367/4708] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:26 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:27.516271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:27.516872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:27.522819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:27.523293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:27.523717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:27.524395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:27.524838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:27.525250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:27.591071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:27.598882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c8397be-8e1f-4935-a2d7-bdfa3f10dd94 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.087190 Sep 01 08:42:27.599462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2342/4709] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:27 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:28.620135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:28.620864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:28.628451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:28.629186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:28.629844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:28.630988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:28.631634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:28.632135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:28.701820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:28.709844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7034d444-ba26-4035-9e6f-061cc8bcf689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.093847 Sep 01 08:42:28.710437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2368/4710] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:28 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:29.730930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:29.731464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:29.737570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:29.738048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:29.738528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:29.739208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:29.739686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:29.740106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:29.800649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:29.808327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f727c788-f769-4442-9a81-65142ec4a1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081341 Sep 01 08:42:29.808896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2343/4711] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:29 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:30.829508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:30.830143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:30.836144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:30.836574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:30.837002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:30.837676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:30.838125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:30.838568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:30.897955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:30.906151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b318cc7c-12b6-45fa-9fe9-6d88df9ef46a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081128 Sep 01 08:42:30.906732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2369/4712] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:30 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:31.927429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:31.928042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:31.934011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:31.934525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:31.934963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:31.935641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:31.936587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:31.937015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:31.998211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:32.006439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f351537b-277a-4a35-a4f1-025bb8507854 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083488 Sep 01 08:42:32.006997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2344/4713] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:31 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:33.027125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:33.027722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:33.034154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:33.034657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:33.035080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:33.035752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:33.036196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:33.036611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:33.097337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:33.104960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd6a0d91-a236-4764-8ebd-aaf229185611 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081782 Sep 01 08:42:33.105519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2370/4714] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:33 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:34.126438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:34.127046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:34.133086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:34.133566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:34.134000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:34.134725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:34.135193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:34.135687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:34.198112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:34.205668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8db6bbfc-bb51-44fe-9970-b8f514d27ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083538 Sep 01 08:42:34.206229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2345/4715] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:34 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:35.226277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:35.226891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:35.233210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:35.233838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:35.234280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:35.234960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:35.235408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:35.235827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:35.295306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:35.302907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5cb6137c-f1e9-4545-9fd7-4f34b25d74ab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080443 Sep 01 08:42:35.303488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2371/4716] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:35 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:36.324256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:36.324856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:36.331068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:36.332277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:36.332277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:36.332630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:36.333075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:36.333490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:36.396256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:36.403867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2a95738c-66e0-4cf5-8fc4-f5b18ac0ebe3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083603 Sep 01 08:42:36.404430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2346/4717] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:36 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:37.425488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:37.426012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:37.432005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:37.432482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:37.432910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:37.433593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:37.434041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:37.434492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:37.648832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:37.656884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5caf48c3-eaa9-49b0-812c-c4ed4543c2da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.235250 Sep 01 08:42:37.657432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2372/4718] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:37 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:38.677080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:38.677693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:38.683764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:38.684247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:38.684676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:38.685368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:38.685852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:38.686800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:38.753942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:38.762585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b41ffec8-2630-4543-a0f5-a1eba13b8e35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.089295 Sep 01 08:42:38.763270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2347/4719] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:38 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:39.784688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:39.785330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:39.787253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:39.792859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:39.793438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:39.793766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:39.794588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:39.795189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:39.795813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:39.800245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:39.856951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:39.864730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-158a68ef-8ed8-484f-9bf4-531b21ff0e3d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084419 Sep 01 08:42:39.865292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2373/4720] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:39 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:40.885307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:40.885969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:40.887804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:40.893568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:40.894035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:40.894509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:40.895187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:40.895608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:40.896019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:40.899986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:40.956244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:40.964004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d9a4bcb0-bc86-4c7a-9cd7-bc0c4a8d24cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082444 Sep 01 08:42:40.964587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2348/4721] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:40 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:41.984416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:41.985017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:41.990931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:41.991405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:41.991829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:41.992504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:41.992942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:41.993355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:42.054399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:42.061798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-69f77686-174a-408e-af91-60fd4a657fb6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081275 Sep 01 08:42:42.062369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2374/4722] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:41 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:43.082887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:43.083529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:43.089424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:43.089896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:43.090361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:43.091043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:43.091521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:43.092378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:43.151578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:43.159904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9eba51d9-010c-44fd-a70c-69887bf99d8b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081373 Sep 01 08:42:43.160464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2349/4723] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:43 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:42:44.180691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:44.181307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:44.187958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:44.188436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:44.188862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:44.189555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:44.190001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:44.190451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:44.250213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:44.257708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f23ca754-2987-48a0-bb9b-e18f7d897202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080913 Sep 01 08:42:44.258278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2375/4724] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:44 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:45.279077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:45.279688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:45.286202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:45.286713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:45.287142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:45.287817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:45.288262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:45.288679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:45.348260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:45.355719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ae5a31c-b2f4-495b-84a9-48395d83c1b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080435 Sep 01 08:42:45.356304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2350/4725] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:45 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:46.377158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:46.377761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:46.383688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:46.384156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:46.384584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:46.385251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:46.385693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:46.386107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:46.448809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:46.456791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d8d69c3-9ead-42b9-ab17-a331d7668508 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084124 Sep 01 08:42:46.457642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2376/4726] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:46 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:47.477189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:47.477791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:47.484606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:47.485078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:47.485503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:47.486180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:47.486656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:47.487074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:47.545515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:47.553647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3d59cf6-5f0a-4e08-bb8b-14218ee71f9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080265 Sep 01 08:42:47.554210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2351/4727] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:47 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:48.574600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:48.575208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:48.581943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:48.582470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:48.582902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:48.583583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:48.584032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:48.584450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:48.646484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:48.654213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e0378454-c994-4f46-a190-e6cd75087bd9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083410 Sep 01 08:42:48.654802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2377/4728] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:48 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:49.675960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:49.676559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:49.682507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:49.682980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:49.683409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:49.684080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:49.684529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:49.684936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:49.744436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:49.752130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e79d6580-7006-4aa4-9c9d-1919c37552da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080230 Sep 01 08:42:49.752682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2352/4729] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:49 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:50.772313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:50.772862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:50.778817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:50.779295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:50.779731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:50.780542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:50.780994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:50.781417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:50.846423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:50.854123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7459b5a-35fd-4fa9-bae4-2f9aeb3a1a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085761 Sep 01 08:42:50.854717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2378/4730] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:50 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:51.875754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:51.876394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:51.882346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:51.882828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:51.883263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:51.883945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:51.884393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:51.884815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:51.946371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:51.954521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a566ae9d-333c-451f-9371-13e70001b55e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083411 Sep 01 08:42:51.955081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2353/4731] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:51 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:52.974815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:52.975432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:52.981367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:52.981846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:52.982898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:52.984116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:52.984569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:52.984989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:53.045167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:53.052743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-179e8c6a-2926-41e1-aabd-5542988f1e1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081761 Sep 01 08:42:53.053424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2379/4732] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:52 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:54.073495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:54.074097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:54.080564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:54.081035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:54.081462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:54.082140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:54.082610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:54.083025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:54.145508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:54.153083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2b812c8b-53eb-4c28-9a63-ef9db32839d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083527 Sep 01 08:42:54.153636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2354/4733] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:54 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:55.173522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:55.174128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:55.180062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:55.180546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:55.180975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:55.181650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:55.182096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:55.182542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:55.245508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:55.253224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-279c82d3-5f1c-41b9-a6f4-9694020e8b22 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084174 Sep 01 08:42:55.253751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2380/4734] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:55 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:56.274189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:56.274816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:56.281356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:56.281827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:56.282271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:56.282943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:56.283384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:56.283799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:56.343484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:56.351036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93eea316-849b-4a7f-9f03-ae9771a86c36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080747 Sep 01 08:42:56.351597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2355/4735] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:56 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:57.371455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:57.371976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:57.378194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:57.378693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:57.379120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:57.379793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:57.380231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:57.380644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:57.439713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:57.447604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-098dab3a-6480-4a31-bd11-08412d95c594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080009 Sep 01 08:42:57.448163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2381/4736] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:57 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:58.468180 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:58.468836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:58.474873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:58.475347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:58.475775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:58.476449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:58.476891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:58.477308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:58.538552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:58.546589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-56c17a14-520b-4944-b79e-f99c2c168ec0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082431 Sep 01 08:42:58.547157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2356/4737] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:58 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:42:59.567036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:42:59.567644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:42:59.573998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:59.574524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:59.574959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:59.575648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:42:59.576105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:42:59.576528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:42:59.639121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:42:59.647442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-57311307-d154-4a08-acf9-41681e16745c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084255 Sep 01 08:42:59.648010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2382/4738] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:42:59 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:00.668565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:00.669168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:00.671782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:43:00.671892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:43:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 (ip 10.222.0.43) !!! Sep 01 08:43:00.678136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:00.678632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:00.679059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:00.679733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:00.680178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:00.680591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:00.744390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:00.752728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80bdae1f-7532-4908-a34d-460602adf047 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.087974 Sep 01 08:43:00.753287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2357/4739] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:00 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:01.773152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:01.773700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:01.780733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:01.781313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:01.781744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:01.782456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:01.782905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:01.783323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:01.843102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:01.850794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38ddffe3-7c1e-44e7-b240-a11d91cceaf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081480 Sep 01 08:43:01.851350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2383/4740] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:01 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:02.871462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:02.872071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:02.879165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:02.879679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:02.880112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:02.880799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:02.881252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:02.881672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:02.943290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:02.951145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-91df2d19-28e4-4d4a-80b9-1104a06fdecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083459 Sep 01 08:43:02.951663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2358/4741] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:02 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:03.971372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:03.971971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:03.977867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:03.978394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:03.978846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:03.979521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:03.979969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:03.980391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:04.044229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:04.052372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33d6d4b6-9a6a-4be2-8fa8-7c413cc763a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084728 Sep 01 08:43:04.052957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2384/4742] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:03 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:05.073187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:05.073863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:05.082148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:05.082703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:05.083194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:05.083942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:05.084446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:05.084862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:05.145801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:05.153308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6efee70b-8c58-42c8-a14f-4efc625c63ee tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083909 Sep 01 08:43:05.153863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2359/4743] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:05 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:06.176433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:06.177045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:06.182942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:06.183423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:06.183865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:06.184538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:06.184990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:06.185412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:06.245716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:06.253241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f76dedfc-6ff0-49e9-bc54-1cfecef9e36a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080602 Sep 01 08:43:06.253799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2385/4744] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:06 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:07.273640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:07.274278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:07.280291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:07.280765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:07.281191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:07.281870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:07.282351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:07.282769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:07.343357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:07.354917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-791a9ee5-dd30-4c35-954d-32d8c35c40e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084972 Sep 01 08:43:07.355416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2360/4745] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:07 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:08.379769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:08.380369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:08.386388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:08.386859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:08.387288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:08.387990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:08.388437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:08.388851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:08.451197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:08.458811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b6c4a180-e7a6-44ba-bcb1-bb1a7114a162 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082928 Sep 01 08:43:08.459355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2386/4746] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:08 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:09.479826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:09.480428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:09.487017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:09.487487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:09.487914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:09.488579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:09.489023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:09.489436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:09.549182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:09.556708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5ab0f611-9f80-42db-bf9f-ac5ff820c1f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080654 Sep 01 08:43:09.557256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2361/4747] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:09 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:10.581016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:10.581604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:10.583512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:10.589085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:10.589569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:10.590002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:10.590757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:10.591207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:10.591628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:10.595483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:10.653616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:10.661591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b3ef3d1-a0dd-432e-8573-b10eeee9ccf3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085101 Sep 01 08:43:10.662152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2387/4748] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:10 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:11.681847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:11.682483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:11.684299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:11.690032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:11.690530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:11.690958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:11.691659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:11.692101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:11.692521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:11.695512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:11.753608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:11.761710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-92481c42-7a38-4f80-8b2c-c60e26426dcc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083580 Sep 01 08:43:11.762285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2362/4749] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:11 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:12.782652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:12.783264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:12.789162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:12.789642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:12.790075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:12.790780 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:12.791232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:12.791663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:12.855222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:12.863542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0bb6a46-9194-4990-8a7b-db76404dee6e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084832 Sep 01 08:43:12.864097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2388/4750] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:12 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:13.884782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:13.885389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:13.892116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:13.892590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:13.893018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:13.893696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:13.894138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:13.894580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:13.954555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:13.962992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-42f69277-535d-4227-88a5-d05d605a0dc1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082045 Sep 01 08:43:13.963559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2363/4751] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:13 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:14.983743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:14.984427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:14.990391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:14.990867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:14.991307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:14.991975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:14.992420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:14.992836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:15.052697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:15.060294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bc117912-8bc0-46ff-a05a-642a9445003b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080919 Sep 01 08:43:15.060848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2389/4752] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:14 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:16.082137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:16.082764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:16.088665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:16.089137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:16.089560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:16.090235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:16.090700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:16.091115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:16.150475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:16.158614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-448158b5-9dcd-4d44-9e41-7a955e5329f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080332 Sep 01 08:43:16.159173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2364/4753] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:16 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:17.179310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:17.179915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:17.185719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:17.186198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:17.187191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:17.187866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:17.188307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:17.188738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:17.251700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:17.259508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-88b8af8e-e8b9-41c5-b028-dc086de3218d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083975 Sep 01 08:43:17.260067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2390/4754] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:17 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:18.280739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:18.281338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:18.287243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:18.287714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:18.288139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:18.288810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:18.289248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:18.289663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:18.351673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:18.359959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-080b68fc-49f9-456c-9174-e5d4ab9b0e71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083613 Sep 01 08:43:18.360506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2365/4755] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:18 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:19.380987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:19.381534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:19.387522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:19.388003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:19.388434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:19.389108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:19.389555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:19.389973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:19.450074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:19.457738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7ba479c-a322-4e58-a635-46a1ddb3f3bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080663 Sep 01 08:43:19.458305 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2391/4756] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:19 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:20.476850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:20.477456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:20.483536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:20.484008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:20.484435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:20.485105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:20.485548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:20.485962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:20.544995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:20.552493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1ff42b4b-b00c-4a54-a792-50a2a28db160 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079482 Sep 01 08:43:20.553043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2366/4757] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:20 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:21.573146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:21.573734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:21.581957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:21.582476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:21.582907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:21.583595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:21.584041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:21.584462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:21.647474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:21.656392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e060097f-5e72-4ded-87f5-f780e512e587 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.087119 Sep 01 08:43:21.656955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2392/4758] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:21 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:22.677244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:22.678018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:22.684243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:22.684714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:22.685136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:22.685810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:22.686648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:22.687184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:22.755551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:22.763400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24c9f2ae-61e3-4289-a43a-6c9250828562 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.089925 Sep 01 08:43:22.763954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2367/4759] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:22 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:23.784481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:23.785083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:23.791107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:23.791583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:23.792009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:23.792683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:23.793125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:23.793541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:23.853487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:23.861054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3ea10c0e-1540-4bd1-922e-03b11273f80a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081150 Sep 01 08:43:23.861612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2393/4760] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:23 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:24.881473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:24.882069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:24.887935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:24.888464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:24.888892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:24.889883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:24.890362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:24.890780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:24.950091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:24.957752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a22f0acf-ccb0-4c4b-a140-6b2a50216d1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080061 Sep 01 08:43:24.958317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2368/4761] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:24 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:25.978595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:25.979204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:25.985896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:25.986409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:25.986861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:25.987531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:25.987999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:25.988407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:26.053237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:26.061128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c8cd1916-25ff-49d5-8b81-0bb0cad96fc3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086440 Sep 01 08:43:26.061697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2394/4762] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:25 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:27.081882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:27.082548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:27.088397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:27.088870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:27.089296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:27.089965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:27.090437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:27.090861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:27.153916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:27.164382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-38fa76ce-6c7a-4d20-9270-5069e01f1202 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086290 Sep 01 08:43:27.164946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2369/4763] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:27 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:28.185167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:28.185748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:28.191808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:28.192285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:28.192711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:28.193646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:28.194120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:28.194568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:28.254768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:28.262251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d9cf90f7-2a36-49f2-84b2-b1422235fc43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080948 Sep 01 08:43:28.262842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2395/4764] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:28 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:29.283245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:29.283851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:29.289779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:29.290250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:29.290705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:29.291381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:29.291833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:29.292248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:29.351505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:29.360105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a0835f2-73a7-42a3-95cf-48c5948e3618 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081202 Sep 01 08:43:29.360667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2370/4765] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:29 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:30.384210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:30.384835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:30.391377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:30.391849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:30.392286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:30.392961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:30.393406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:30.393823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:30.456635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:30.464199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c8a7ae87-c5f7-402f-92ae-20370a4199ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083808 Sep 01 08:43:30.464755 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2396/4766] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:30 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:31.484842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:31.485550 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:31.491458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:31.491927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:31.492352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:31.493021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:31.493464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:31.493876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:31.556647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:31.564281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cf0929c2-eeb8-4714-b19e-70e2c6e405e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083302 Sep 01 08:43:31.564843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2371/4767] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:31 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:32.584790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:32.585393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:32.591425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:32.591903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:32.592951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:32.593639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:32.594084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:32.594534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:32.657177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:32.664803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0e672e3c-e317-46ae-958e-bc6c8ed9424c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083867 Sep 01 08:43:32.665358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2397/4768] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:32 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:33.684918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:33.685646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:33.691595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:33.692069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:33.692497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:33.693442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:33.693887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:33.694330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:33.755188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:33.762813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2e6e0d0e-8593-4ff9-b1cb-d3c42318a941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081692 Sep 01 08:43:33.763373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2372/4769] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:33 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:34.784342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:34.784984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:34.790999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:34.791480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:34.791910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:34.792589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:34.793034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:34.793453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:34.857298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:34.864873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e95e569b-24d8-4298-bf8b-5c3bbb5fe0d2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084982 Sep 01 08:43:34.865433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2398/4770] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:34 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:35.886502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:35.887259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:35.895096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:35.895570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:35.895997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:35.896671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:35.897113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:35.897537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:35.957074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:35.964546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-32ae8513-63d2-4251-a8f1-6928c232276c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083208 Sep 01 08:43:35.965097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2373/4771] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:35 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:43:36.985152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:36.985762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:36.991733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:36.992209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:36.992640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:36.993319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:36.993763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:36.994186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:37.055034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:37.064476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c2945307-0b0e-4b54-9420-3aeaa183fada tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083035 Sep 01 08:43:37.065052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2399/4772] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:36 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:38.086504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:38.087571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:38.096697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:38.098727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:38.098727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:38.098727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:38.099001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:38.099544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:38.169615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:38.178668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cf86d2a8-8b7f-4d23-b5b6-85b9a3de8816 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.096164 Sep 01 08:43:38.179266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2374/4773] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:38 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:39.202944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:39.203545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:39.209347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:39.209818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:39.210240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:39.210976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:39.211425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:39.211842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:39.273390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:39.281507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae59296d-f06c-4d7b-a98d-a8fe419563f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082866 Sep 01 08:43:39.282297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2400/4774] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:39 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:40.302279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:40.302887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:40.308900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:40.309376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:40.309790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:40.310486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:40.311539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:40.311982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:40.371465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:40.379578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dac7626e-6850-4e48-b71e-0eada5a4f598 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081194 Sep 01 08:43:40.380130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2375/4775] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:40 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:41.401008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:41.401613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:41.403419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:41.408436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:41.408917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:41.409345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:41.410207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:41.410504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:41.410924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:41.415157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:41.473742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:41.481269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-935b556d-9244-4f5a-911a-978db0057dec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084515 Sep 01 08:43:41.481820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2401/4776] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:41 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:42.506015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:42.506714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:42.509520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:42.515617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:42.516197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:42.516633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:42.517320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:42.517822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:42.518241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:42.521201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:43:42.580072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:42.587676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8c8c0d2-ca06-4287-a921-696e16140594 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.089031 Sep 01 08:43:42.588241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2376/4777] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:42 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:43.609166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:43.609770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:43.615664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:43.616133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:43.616557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:43.617226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:43.617670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:43.618084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:43.681491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:43.689099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9e26f653-02b6-4bae-bdfa-2093ed66f115 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084626 Sep 01 08:43:43.689651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2402/4778] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:43 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:44.710145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:44.710770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:44.716791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:44.717298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:44.717737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:44.718483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:44.718925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:44.719339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:44.783140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:44.790694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-57b13cbb-4bd4-43e7-ae76-445e4c380cea tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084343 Sep 01 08:43:44.791252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2377/4779] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:44 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:45.811672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:45.812272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:45.818374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:45.818842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:45.819265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:45.819933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:45.820380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:45.820788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:45.880310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:45.887837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7dc15b79-deb5-447c-8e2b-0905eae5e688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080235 Sep 01 08:43:45.888400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2403/4780] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:45 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:46.907755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:46.908394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:46.914381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:46.914861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:46.915293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:46.915969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:46.916418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:46.916844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:46.976714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:46.984975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b78741ac-4fba-451e-97f6-e2d83256894e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081026 Sep 01 08:43:46.985532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2378/4781] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:46 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:48.005099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:48.005709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:48.011612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:48.012083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:48.012510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:48.013180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:48.014381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:48.014829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:48.078595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:48.086306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-64c49d8f-9e07-47c7-ae3d-4b54ca2a1464 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084907 Sep 01 08:43:48.086879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2404/4782] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:48 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:49.106891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:49.107497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:49.113759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:49.114235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:49.114705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:49.115383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:49.115827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:49.116252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:49.178338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:49.185800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3100a3af-013b-4200-8603-d1bc48f492b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082735 Sep 01 08:43:49.186380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2379/4783] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:49 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:50.207445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:50.208037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:50.214001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:50.214514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:50.214953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:50.215636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:50.216089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:50.216512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:50.276303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:50.284037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-729f218c-62e2-417e-b7a2-d02fa14b8a95 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080620 Sep 01 08:43:50.284597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2405/4784] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:50 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:51.304706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:51.305305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:51.312224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:51.312710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:51.313140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:51.313832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:51.314298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:51.314721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:51.373879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:51.381375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f5a21f2d-bbf8-4380-b9c2-57f1108139fc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080472 Sep 01 08:43:51.381948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2380/4785] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:51 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:52.402457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:52.403098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:52.409228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:52.409707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:52.410137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:52.410843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:52.411294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:52.411714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:52.473718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:52.481221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4973ad8e-4000-4ac1-a1d3-e2dfac979e16 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082626 Sep 01 08:43:52.481773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2406/4786] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:52 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:53.502867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:53.503470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:53.509751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:53.510224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:53.510687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:53.511362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:53.511805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:53.512221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:53.574729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:53.582695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-87fed26a-9184-4fee-bb40-34d155f5d246 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084383 Sep 01 08:43:53.583261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2381/4787] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:53 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:54.603566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:54.604164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:54.610636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:54.611110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:54.611532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:54.612307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:54.612643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:54.613053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:54.672582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:54.679974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3143fd63-5a0f-4cfe-98b0-8eb1c4ff9582 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080233 Sep 01 08:43:54.680531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2407/4788] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:54 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:43:55.700941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:55.701568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:55.707668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:55.708143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:55.708568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:55.709245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:55.709695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:55.710112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:55.769402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:55.776881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-50db179d-9207-4f7b-b1cf-1aabbb12b85e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079790 Sep 01 08:43:55.777438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2382/4789] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:55 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:56.797971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:56.798587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:56.804441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:56.804915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:56.805343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:56.806013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:56.806481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:56.806894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:56.868777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:56.876740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-86849c04-06f0-4c97-9cb0-9282c05a09ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083410 Sep 01 08:43:56.877319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2408/4790] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:56 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:57.896977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:57.897579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:57.903925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:57.904403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:57.905483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:57.906249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:57.906730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:57.907151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:57.966195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:57.974440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4236cd94-f2f9-4bae-bda3-d0c543c5a111 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081256 Sep 01 08:43:57.974999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2383/4791] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:57 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:43:58.994697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:43:58.995308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:43:59.001687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:59.002164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:59.002626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:59.003296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:43:59.003739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:43:59.004150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:43:59.062982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:43:59.071010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-57448aa1-5be7-4a6e-bc47-21d596a8b915 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080158 Sep 01 08:43:59.071574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2409/4792] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:43:58 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:00.093089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:00.093654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:00.099577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:00.100051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:00.100570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:00.103590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:00.104057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:00.104491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:00.164277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:00.172330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d8aa33cd-d6c7-4eb5-81db-8bd0ab11512f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084663 Sep 01 08:44:00.172886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2384/4793] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:00 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:01.193136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:01.193744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:01.199633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:01.200107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:01.200538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:01.201212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:01.202233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:01.202718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:01.265566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:01.273136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d03f48ce-3ce5-4a1d-9a6a-d4db476b4b1d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084157 Sep 01 08:44:01.273695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2410/4794] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:01 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:44:02.293995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:02.294668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:02.301214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:02.301774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:02.302101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:02.302789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:02.303228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:02.303639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:02.363482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:02.371042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-42bddf6c-e645-410e-96d0-5e8260b9bc04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080863 Sep 01 08:44:02.371605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2385/4795] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:02 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:03.392179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:03.392779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:03.398775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:03.399247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:03.399674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:03.400374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:03.400812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:03.401228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:03.461554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:03.469577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1875b1d4-a1e5-4f2b-ac1d-9f660fe30489 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081859 Sep 01 08:44:03.470136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2411/4796] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:03 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:04.489932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:04.490575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:04.496621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:04.497103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:04.497538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:04.498218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:04.499395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:04.499890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:04.558767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:04.567034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62ae1d44-62df-4864-8649-385c168fee12 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080948 Sep 01 08:44:04.567857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2386/4797] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:04 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:05.588470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:05.589084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:05.595635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:05.596114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:05.596548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:05.597232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:05.597683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:05.598105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:05.660955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:05.668480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c96291a-2af7-4b05-ac9f-53d09dd83d02 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083856 Sep 01 08:44:05.669036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2412/4798] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:05 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:06.688794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:06.689446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:06.695604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:06.696082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:06.696518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:06.697198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:06.697646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:06.698065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:06.759535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:06.767351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fae28580-2965-42f6-92b8-2d65120808fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082858 Sep 01 08:44:06.767911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2387/4799] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:06 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:07.788456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:07.789065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:07.795081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:07.796069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:07.796494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:07.797163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:07.797606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:07.798021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:07.860915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:07.869328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-00dc9368-7c51-4f8a-acc2-179c2c4c6f91 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084700 Sep 01 08:44:07.869887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2413/4800] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:07 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:08.892074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:08.892689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:08.898624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:08.899097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:08.899527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:08.900207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:08.900653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:08.901069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:08.962694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:08.970942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d54bda75-7cb0-4c96-9076-44cbab5e1757 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082858 Sep 01 08:44:08.971731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2388/4801] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:08 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:09.991974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:09.992572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:09.999077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:09.999580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:10.000008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:10.000681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:10.001115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:10.001529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:10.064153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:10.071920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-672e2d76-27ac-4e31-b956-cc07bff255cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083720 Sep 01 08:44:10.072474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2414/4802] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:09 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:11.093317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:11.093933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:11.099979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:11.100458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:11.100890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:11.101576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:11.102024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:11.102479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:11.171163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:11.179268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f817c7a6-065c-4890-b595-419fb95144bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.090243 Sep 01 08:44:11.179854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2389/4803] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:11 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:12.199781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:12.200377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:12.202901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:12.208128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:12.208598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:12.209020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:12.209692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:12.210134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:12.210575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:12.213099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:12.271132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:12.278537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b17a67af-6a84-4135-b3aa-a16ca40c9d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082526 Sep 01 08:44:12.279091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2415/4804] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:12 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:13.300601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:13.301200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:13.303065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:13.308171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:13.308648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:13.309078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:13.309755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:13.310203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:13.310643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:13.313359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:13.371104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:13.379136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a91e3413-ef20-4aa7-a846-b0c8ec33ff0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082361 Sep 01 08:44:13.379691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2390/4805] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:13 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:14.399762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:14.400372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:14.407384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:14.407863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:14.408292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:14.409015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:14.409461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:14.409878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:14.472829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:14.480408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f0fcfb02-3e94-4b60-9a13-2cd97125c5a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084523 Sep 01 08:44:14.480963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2416/4806] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:14 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:15.501206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:15.501807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:15.507897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:15.508356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:15.508779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:15.509458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:15.509892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:15.510386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:15.570967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:15.579088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e580f890-9a67-4fbb-9704-0080a90144a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082244 Sep 01 08:44:15.579622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2391/4807] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:15 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:16.599532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:16.600171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:16.606043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:16.606554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:16.606990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:16.607669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:16.608796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:16.609234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:16.668447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:16.676607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-04b31c75-65ef-4eef-8f41-0da8547c2419 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080955 Sep 01 08:44:16.677162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2417/4808] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:16 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:17.698045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:17.698665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:17.705133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:17.705599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:17.706023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:17.706769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:17.707201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:17.707614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:17.767598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:17.775139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7719e486-18f0-4f33-9e1b-dcd3d19c34cc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080926 Sep 01 08:44:17.775705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2392/4809] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:17 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:18.796264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:18.796891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:18.803201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:18.803676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:18.804106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:18.804782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:18.805244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:18.805646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:18.868172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:18.875788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-25e526ee-3325-4b80-9f21-e2d9cf107eb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084054 Sep 01 08:44:18.876354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2418/4810] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:18 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:19.896090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:19.896696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:19.902616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:19.903089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:19.903517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:19.904189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:19.904635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:19.905067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:19.964741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:19.972541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b426953-9aed-43d0-ba17-69b0766e22b0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080335 Sep 01 08:44:19.973097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2393/4811] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:19 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:20.993340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:20.993953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:20.999954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:21.000430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:21.000863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:21.001545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:21.001994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:21.002457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:21.062541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:21.070362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6e5652b8-dcc1-467a-86b4-d107efe9f225 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080979 Sep 01 08:44:21.070917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2419/4812] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:20 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:44:22.090961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:22.091587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:22.097513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:22.097986 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:22.098449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:22.099124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:22.099564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:22.099980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:22.159833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:22.167438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-79d50167-13a7-4e80-90e2-5a3a389cc49b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080350 Sep 01 08:44:22.167990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2394/4813] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:22 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:23.188329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:23.189031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:23.195331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:23.195805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:23.196232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:23.196911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:23.197672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:23.198155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:23.262691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:23.270296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1df611c-1b57-4ac6-87ee-a5516e2205e3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085888 Sep 01 08:44:23.270850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2420/4814] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:23 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:44:24.291971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:24.292823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:24.298974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:24.299443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:24.299865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:24.300538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:24.300984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:24.301396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:24.360777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:24.368262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2608e86b-2c33-4a8a-ac5b-fac86f5c0846 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080150 Sep 01 08:44:24.368837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2395/4815] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:24 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:25.388259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:25.388904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:25.395100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:25.395584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:25.396020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:25.396700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:25.397153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:25.397576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:25.457253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:25.464732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c747718-9851-4d19-8e7f-26fefdaf84a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080328 Sep 01 08:44:25.465284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2421/4816] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:25 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:26.486304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:26.487039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:26.493014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:26.493486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:26.493909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:26.494605 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:26.495048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:26.495462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:26.554401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:26.562676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26bb8996-4596-4ad5-8760-c870054eac3a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080133 Sep 01 08:44:26.563350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2396/4817] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:26 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:27.584154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:27.584768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:27.590665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:27.591142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:27.591572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:27.592250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:27.592699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:27.593237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:27.655036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:27.662568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b1659b89-2a52-4422-a6c5-ae6be321adb9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082175 Sep 01 08:44:27.663132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2422/4818] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:27 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:28.682956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:28.683567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:28.689668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:28.690182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:28.690636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:28.691499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:28.692206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:28.692772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:28.753963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:28.761619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-079ae76a-5914-4f5c-bbee-212ea381b4e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082533 Sep 01 08:44:28.762174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2397/4819] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:28 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:29.783073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:29.783678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:29.789545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:29.790022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:29.790500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:29.791177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:29.791629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:29.792047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:29.853614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:29.861704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c72fc691-79c0-4a3a-a5b4-20c53a5916b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083153 Sep 01 08:44:29.862263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2423/4820] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:29 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:30.882150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:30.882758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:30.888742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:30.889219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:30.889689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:30.890386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:30.890833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:30.891324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:30.954465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:30.961955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-663d8ea3-a535-41ef-bb25-61a213e7f0a6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083660 Sep 01 08:44:30.962544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2398/4821] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:30 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:31.982510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:31.983142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:31.989177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:31.989648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:31.990073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:31.990769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:31.991211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:31.991632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:32.053548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:32.061082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b260a592-2f39-4ac5-9cbc-69ac50dbeed5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082408 Sep 01 08:44:32.061631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2424/4822] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:31 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:33.083109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:33.083751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:33.089625 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:33.090134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:33.090593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:33.091268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:33.091714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:33.092132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:33.151551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:33.160031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b2b7d9d2-8d41-4ba5-b553-2d54842080a7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081541 Sep 01 08:44:33.160602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2399/4823] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:33 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:34.180876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:34.181465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:34.187369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:34.187854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:34.188874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:34.189726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:34.190178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:34.190640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:34.252843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:34.260595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a48c1371-ba41-4777-97de-e0e8afb800e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083481 Sep 01 08:44:34.261156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2425/4824] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:34 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:35.282091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:35.282738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:35.288647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:35.289117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:35.289543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:35.290212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:35.290682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:35.291099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:35.351346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:35.359047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62d450db-5306-4c8c-a5a8-b4523abd08c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080857 Sep 01 08:44:35.359592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2400/4825] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:35 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:36.380502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:36.381107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:36.387207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:36.387685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:36.388114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:36.388795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:36.389241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:36.389660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:36.452275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:36.460111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5aa119a2-74e4-4b51-ad3a-a5d0a9e52cd5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083629 Sep 01 08:44:36.460667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2426/4826] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:36 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:37.481363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:37.481980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:37.488035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:37.488516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:37.488950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:37.489643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:37.490091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:37.490545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:37.550375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:37.557899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a1ae8b58-dca7-4913-93c3-83b4d34b9cf6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080495 Sep 01 08:44:37.558493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2401/4827] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:37 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:38.579623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:38.580228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:38.586183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:38.586692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:38.587124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:38.587807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:38.588256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:38.588674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:38.648994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:38.656909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ccb78d17-42f3-4d88-9ed4-e914d19393c4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081046 Sep 01 08:44:38.657513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2427/4828] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:38 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:39.680895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:39.681552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:39.687401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:39.687913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:39.688341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:39.689036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:39.689484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:39.689898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:39.751383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:39.758881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3437c9ba-46ed-4076-b257-1fd213e092ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081797 Sep 01 08:44:39.759436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2402/4829] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:39 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:40.779806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:40.780418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:40.787136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:40.787618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:40.788050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:40.788735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:40.789189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:40.789609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:40.853211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:40.860871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e8385f1-d246-4472-8c0c-76ec837642a5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084910 Sep 01 08:44:40.861434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2428/4830] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:40 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:41.881081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:41.881682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:41.883682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:44:41.883826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:44:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 (ip 10.222.0.43) !!! Sep 01 08:44:41.890691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:41.891244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:41.891675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:41.892359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:41.892808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:41.893229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:41.956794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:41.964346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e4cf4440-6a82-4a3e-83f3-6ed9b91cb5d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.087086 Sep 01 08:44:41.964919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2403/4831] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:41 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:42.985025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:42.985634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:42.987864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:42.992969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:42.993448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:42.993877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:42.994589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:42.995038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:42.995457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:42.998119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:43.059643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:43.067457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd4b719b-63e5-4829-8645-9689d6d34808 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086370 Sep 01 08:44:43.068014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2429/4832] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:42 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:44.088504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:44.089104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:44.091108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:44.096929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:44.097418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:44.097856 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:44.098596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:44.099050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:44.099475 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:44.102073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:44.160247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:44.167793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1774059d-6661-48ca-9dc0-ebb2dbf2d453 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083121 Sep 01 08:44:44.168352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2404/4833] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:44 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:44:45.187133 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:45.187785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:45.194523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:45.194999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:45.195425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:45.196102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:45.196543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:45.196956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:45.258754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:45.266980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f244dd1b-0206-428e-a80d-3261f95c5258 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083461 Sep 01 08:44:45.267537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2430/4834] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:45 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:46.288106 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:46.288734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:46.294666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:46.295150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:46.295622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:46.296299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:46.296753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:46.297236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:46.357447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:46.364956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7eb5a286-a5fb-44da-9b37-3a0683eec0cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080686 Sep 01 08:44:46.365733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2405/4835] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:46 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:47.384890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:47.385485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:47.391662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:47.392130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:47.392559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:47.393230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:47.393670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:47.394084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:47.453693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:47.461173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0f2e6d86-9c0a-49d9-8dfd-e41360ca20a2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080117 Sep 01 08:44:47.461724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2431/4836] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:47 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:48.480823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:48.481432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:48.488088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:48.488559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:48.488987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:48.489652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:48.490094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:48.490534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:48.550922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:48.558418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c807fa64-9575-4fed-bd32-91e2018a5ce4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081369 Sep 01 08:44:48.558985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2406/4837] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:48 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:49.580035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:49.580645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:49.586637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:49.587117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:49.587552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:49.588237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:49.588689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:49.589110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:49.651144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:49.658681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5a5a9536-acfa-43bb-9498-d40eb5f647bc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082707 Sep 01 08:44:49.659249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2432/4838] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:49 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:50.679247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:50.679851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:50.685869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:50.686375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:50.686802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:50.687565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:50.688691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:50.689149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:50.749619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:50.757442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-95582add-316a-4aff-b461-63c3db945968 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082151 Sep 01 08:44:50.757995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2407/4839] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:50 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:51.777575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:51.778102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:51.784193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:51.784666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:51.785090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:51.785757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:51.786197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:51.786635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:51.846127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:51.853654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c26cef1d-8d48-4b2f-b67a-8854aa677b01 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079970 Sep 01 08:44:51.854210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2433/4840] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:51 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:52.876031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:52.876666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:52.882715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:52.883195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:52.883621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:52.884308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:52.884759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:52.885177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:52.946657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:52.954566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-641d363b-ca9d-4d65-a549-b43343cfc536 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083340 Sep 01 08:44:52.955132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2408/4841] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:52 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:53.975077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:53.975719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:53.981947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:53.982459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:53.982882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:53.983556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:53.983994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:53.984416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:54.049464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:54.056951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b2af028-34c7-4c10-aa60-674a5f7c40ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085677 Sep 01 08:44:54.057514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2434/4842] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:53 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:55.078681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:55.079356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:55.085324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:55.085818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:55.086250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:55.087176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:55.087428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:55.087857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:55.147996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:55.155616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-483b9809-e046-4ecd-9575-6b069840fda8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080793 Sep 01 08:44:55.156174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2409/4843] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:55 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:56.176670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:56.177222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:56.183100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:56.183575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:56.184005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:56.184679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:56.185122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:56.185539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:56.244568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:56.251997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd577c48-59a8-49e8-b5f3-e6b9225b70af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079216 Sep 01 08:44:56.252554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2435/4844] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:56 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:57.272686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:57.273294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:57.279256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:57.279768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:57.280200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:57.280878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:57.281395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:57.281836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:57.342388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:57.349915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-401f20d6-8ed2-46c3-8d05-55173fb4edf4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081073 Sep 01 08:44:57.350505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2410/4845] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:57 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:58.369983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:58.370638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:58.377330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:58.377802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:58.378226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:58.378915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:58.379358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:58.379830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:58.441538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:58.449093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-45cee4c9-bec8-4a4a-965c-4f83f73ecb51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082957 Sep 01 08:44:58.449642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2436/4846] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:58 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:44:59.473285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:44:59.473903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:44:59.480007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:59.480489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:59.480921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:59.481610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:44:59.482058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:44:59.482512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:44:59.543204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:44:59.551419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8475eb87-b900-4131-b9f2-83e3e733ce50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084558 Sep 01 08:44:59.551988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2411/4847] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:44:59 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:00.572651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:00.573253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:00.579490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:00.579962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:00.580388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:00.581070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:00.581513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:00.581922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:00.641953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:00.650195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5537f1d-d63d-4ac6-a9b6-bdb90f649e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081421 Sep 01 08:45:00.650786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2437/4848] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:00 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:01.671302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:01.672407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:01.678238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:01.678736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:01.679163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:01.679832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:01.680274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:01.680687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:01.740081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:01.747527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd6c66c9-ce79-46cd-8ce9-935e62809909 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080354 Sep 01 08:45:01.748075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2412/4849] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:01 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:02.769252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:02.769813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:02.775631 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:02.776100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:02.776525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:02.777193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:02.777633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:02.778053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:02.839499 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:02.847224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ffa93c8-2361-413c-9d7c-3960aee753f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082628 Sep 01 08:45:02.847775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2438/4850] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:02 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:03.866971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:03.867610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:03.873453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:03.873923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:03.874378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:03.875683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:03.876123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:03.876542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:03.935213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:03.946407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ce0eb5bf-c220-4389-8982-267b35b84ae5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083159 Sep 01 08:45:03.947041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2413/4851] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:03 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:04.969148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:04.969759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:04.975682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:04.976155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:04.976583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:04.977255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:04.977707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:04.978126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:05.037242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:05.044813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6cb0f408-97ca-4ef5-9c2e-ae951a8df5bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079662 Sep 01 08:45:05.045373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2439/4852] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:04 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:06.066383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:06.066984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:06.072874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:06.073344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:06.073768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:06.074465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:06.074910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:06.075328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:06.136147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:06.143840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-928640e2-23ac-435d-a4e3-5183a202889b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082232 Sep 01 08:45:06.144400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2414/4853] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:06 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:07.164452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:07.165088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:07.170995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:07.171506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:07.172063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:07.172708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:07.173173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:07.173583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:07.235460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:07.243025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6a267725-ebf3-4908-b22c-8d0ca0e4809c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082400 Sep 01 08:45:07.243580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2440/4854] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:07 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:08.264174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:08.264829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:08.271258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:08.271727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:08.272152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:08.272824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:08.273264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:08.273679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:08.332768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:08.340470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6a1aacca-51ff-4328-b03b-f329401f9136 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080138 Sep 01 08:45:08.341036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2415/4855] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:08 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:09.361859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:09.362543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:09.368561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:09.369036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:09.369463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:09.370139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:09.370620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:09.371041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:09.430936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:09.439490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1e0f7e5-4a56-4724-b6ae-4c0cdb3816be tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082002 Sep 01 08:45:09.440067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2441/4856] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:09 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:10.459983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:10.460622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:10.466675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:10.467157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:10.467589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:10.468775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:10.469224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:10.469649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:10.529158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:10.537239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24de06b8-b308-458e-bf00-1adc7cf5b9f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081063 Sep 01 08:45:10.537808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2416/4857] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:10 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:11.558234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:11.558866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:11.565115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:11.565594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:11.566318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:11.567021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:11.567512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:11.569650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:11.634512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:11.643274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24e2381a-6734-4ec2-b6b4-c42aa4989180 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.088695 Sep 01 08:45:11.643844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2442/4858] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:11 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:12.664980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:12.665577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:12.672070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:12.672545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:12.672968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:12.673641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:12.674084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:12.674590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:12.735123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:12.742699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d0306e67-5e1f-4727-a716-89fde4c2bad3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081584 Sep 01 08:45:12.743280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2417/4859] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:12 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:13.763141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:13.763725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:13.765694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:13.770991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:13.771468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:13.771895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:13.772568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:13.773015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:13.773431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:13.777471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:13.834785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:13.842250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c56cc06f-1709-4987-a04e-04ee46dcbfab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082997 Sep 01 08:45:13.842825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2443/4860] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:13 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:14.862067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:14.862676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:14.864497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:14.869894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:14.870402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:14.870866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:14.871578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:14.872027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:14.872446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:14.877206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:14.932564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:14.940962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d76414c5-3dc1-45a2-b994-8ee9b6b4126f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082500 Sep 01 08:45:14.941533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2418/4861] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:14 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:15.962004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:15.962658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:15.969415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:15.969898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:15.970370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:15.971050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:15.971501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:15.971923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:16.033868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:16.045313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e627a0e9-71e5-4b08-8b47-efac7af6af1a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.087234 Sep 01 08:45:16.045878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2444/4862] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:15 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:17.066830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:17.067435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:17.073308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:17.073781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:17.074208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:17.074902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:17.075343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:17.075761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:17.135876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:17.144056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ee3b7cd0-fb8f-44bf-8f84-d03e595df5d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081315 Sep 01 08:45:17.144633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2419/4863] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:17 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:18.164195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:18.164817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:18.170727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:18.171203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:18.172199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:18.173015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:18.173466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:18.173886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:18.232826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:18.240872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7dc269b3-d785-4757-b471-38974a23e852 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080492 Sep 01 08:45:18.241430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2445/4864] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:18 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:19.262087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:19.262718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:19.269704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:19.270190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:19.270650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:19.271346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:19.273519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:19.273974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:19.340442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:19.348617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5ff195d0-3543-4395-a86c-02abf71b8094 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.090319 Sep 01 08:45:19.349177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2420/4865] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:19 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:20.368686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:20.369288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:20.375361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:20.375830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:20.376875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:20.377592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:20.378036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:20.378474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:20.441417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:20.451021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-45acc5e0-d202-42a3-ad1c-d7d0b843ea0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086124 Sep 01 08:45:20.451585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2446/4866] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:20 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:21.471749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:21.472119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:21.477896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:21.478408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:21.478837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:21.479514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:21.479959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:21.480376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:21.540330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:21.547862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9eacc86c-b4b3-45f2-af73-03ebeb2cf7f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080443 Sep 01 08:45:21.548418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2421/4867] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:21 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:22.568881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:22.569517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:22.575798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:22.576281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:22.576705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:22.577388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:22.577832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:22.578247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:22.638687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:22.646885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4db1a786-d802-4076-85ce-aecf5cdcd09c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082067 Sep 01 08:45:22.647509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2447/4868] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:22 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:23.667828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:23.668454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:23.675195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:23.675688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:23.676122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:23.676824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:23.677272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:23.677694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:23.743069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:23.750907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7356d007-cc47-4c64-8804-6b5765496d04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086876 Sep 01 08:45:23.751485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2422/4869] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:23 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:24.772126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:24.772718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:24.778536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:24.779010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:24.779430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:24.780100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:24.780541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:24.780957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:24.843159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:24.851574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5da31410-7755-4c4a-b70b-07b7b2abf5f1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083861 Sep 01 08:45:24.852132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2448/4870] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:24 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:25.872104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:25.872702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:25.879495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:25.879847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:25.880281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:25.885913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:25.885913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:25.885913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:25.944082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:25.951847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-625b04fa-032e-46b3-aa7a-a4d37a4fc2c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083588 Sep 01 08:45:25.952403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2423/4871] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:25 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:26.973309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:26.974016 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:26.979858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:26.980330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:26.980752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:26.981419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:26.981858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:26.982302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:27.041295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:27.048879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5169ad42-8d70-42a5-823f-93acd3667bfc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080164 Sep 01 08:45:27.049443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2449/4872] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:26 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:28.070428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:28.071030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:28.076907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:28.077376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:28.077802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:28.078499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:28.078946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:28.079359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:28.138901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:28.146694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a4907f0f-bd99-4e4e-b917-4d87981d9028 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080922 Sep 01 08:45:28.147252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2424/4873] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:28 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:29.166698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:29.167304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:29.173207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:29.173676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:29.174103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:29.174814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:29.175257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:29.176345 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:29.238386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:29.245879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4aef9f98-5574-4f77-9f13-400e1c338d5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082963 Sep 01 08:45:29.246465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2450/4874] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:29 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:30.267484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:30.268152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:30.274727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:30.275213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:30.275645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:30.276322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:30.276768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:30.277193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:30.339635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:30.347193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bf6fe06e-f542-4e01-b429-34ed47a05c43 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083591 Sep 01 08:45:30.347793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2425/4875] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:30 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:31.367169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:31.367776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:31.374501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:31.374979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:31.375408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:31.376088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:31.376539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:31.376961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:31.436996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:31.445754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b90ef41a-0305-4e40-b4c2-1b1f9750deeb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082337 Sep 01 08:45:31.446340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2451/4876] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:31 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:32.466595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:32.467207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:32.473271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:32.473740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:32.474170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:32.474879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:32.475324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:32.475738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:32.534689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:32.542142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8c21b684-227e-4705-81f6-7d65bb90e213 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079338 Sep 01 08:45:32.542722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2426/4877] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:32 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:33.563539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:33.564147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:33.571159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:33.571646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:33.572077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:33.572776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:33.573227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:33.573650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:33.636169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:33.643787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f99d735f-baa6-48e7-9294-aa1cce73faa3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084082 Sep 01 08:45:33.645005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2452/4878] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:33 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:34.665032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:34.665637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:34.671542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:34.672022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:34.672454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:34.673128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:34.673574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:34.673991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:34.733928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:34.742067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5a75de36-eafb-4738-b194-d204e006ba5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080971 Sep 01 08:45:34.742654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2427/4879] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:34 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:35.763604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:35.764489 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:35.772449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:35.772967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:35.773461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:35.774358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:35.775011 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:35.775436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:35.836969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:35.844487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4313d49d-c125-4c39-b038-7d93d3bab3b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084946 Sep 01 08:45:35.845033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2453/4880] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:35 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:36.866436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:36.867044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:36.873011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:36.873482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:36.873909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:36.874606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:36.875051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:36.875465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:36.934595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:36.942944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6dcf076d-906f-440e-87cf-7c68b90e2af3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081555 Sep 01 08:45:36.943502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2428/4881] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:36 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:37.963373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:37.963980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:37.969813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:37.970279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:37.970722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:37.971390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:37.971858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:37.972269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:38.033255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:38.041536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-adbec70d-b3b2-4613-9603-46bd15aa5685 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082111 Sep 01 08:45:38.042092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2454/4882] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:37 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:39.062795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:39.063427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:39.069830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:39.070333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:39.070765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:39.071451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:39.071896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:39.072316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:39.132328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:39.139907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-937aaac8-a3f9-4fd2-8840-18e9ea38085f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080951 Sep 01 08:45:39.140463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2429/4883] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:39 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:40.161079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:40.161630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:40.167664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:40.168178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:40.168615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:40.169335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:40.169788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:40.170245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:40.231577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:40.239377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a5f06fb-90b7-4113-b8c8-935512e29cf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082153 Sep 01 08:45:40.239951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2455/4884] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:40 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:41.261730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:41.262385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:41.269038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:41.269567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:41.270002 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:41.270721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:41.271167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:41.271584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:41.346444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:41.355063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-636fab01-1156-4dc6-91f6-e84e91674d99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.098553 Sep 01 08:45:41.355732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2430/4885] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:41 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:42.378696 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:42.379827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:42.385788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:42.386278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:42.386718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:42.387385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:42.387827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:42.388238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:42.450888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:42.459196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c712ad13-1cae-4aaf-9e76-61a9da04ace1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084292 Sep 01 08:45:42.459752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2456/4886] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:42 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:43.479548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:43.480150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:43.486104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:43.486608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:43.487038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:43.487709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:43.488695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:43.489116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:43.550071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:43.558294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a1a20b77-4848-44d9-859e-5fa7ac77a630 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082446 Sep 01 08:45:43.558857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2431/4887] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:43 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:44.578734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:44.579330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:44.581209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:44.587249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:44.587730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:44.588158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:44.588838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:44.589277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:44.589688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:44.592214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:44.649752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:44.657475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-61cee19b-c7f5-42e5-81fa-4338c7f02792 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082548 Sep 01 08:45:44.658029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2457/4888] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:44 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:45.678522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:45.679138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:45.680980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:45.686052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:45.686557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:45.686985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:45.687663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:45.688109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:45.688525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:45.691496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:45.749654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:45.757338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b6af820-d2f5-4af4-a822-25b575a3d62e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083236 Sep 01 08:45:45.757883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2432/4889] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:45 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:46.779702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:46.780370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:46.786771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:46.787246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:46.787675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:46.788349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:46.788796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:46.789212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:46.851025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:46.858618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-93b173d5-316a-4ab9-ac9b-02301f5f2638 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082713 Sep 01 08:45:46.859183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2458/4890] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:46 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:47.878964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:47.879591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:47.885556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:47.886021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:47.886484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:47.887157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:47.887624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:47.888036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:47.948716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:47.957841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-488c8570-9bc3-4839-bc6e-827b6ea84d3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082000 Sep 01 08:45:47.958479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2433/4891] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:47 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:48.978781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:48.979382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:48.985235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:48.985701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:48.986130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:48.986831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:48.987269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:48.987684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:49.047323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:49.055185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f64ef5e-c2a9-4d04-b3aa-b5445378579c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080223 Sep 01 08:45:49.055732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2459/4892] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:48 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:45:50.076261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:50.076791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:50.083341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:50.083819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:50.084253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:50.084931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:50.085384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:50.085807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:50.144834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:50.152392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aff32822-b73a-4646-8a08-67b291f4a5fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080047 Sep 01 08:45:50.152949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2434/4893] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:50 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:51.172813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:51.173445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:51.180206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:51.180685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:51.181112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:51.181789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:51.182239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:51.182681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:51.244739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:51.252200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3087bff1-b07a-42bf-b9a4-e00a12d53c30 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083228 Sep 01 08:45:51.252766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2460/4894] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:51 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:52.273756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:52.274400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:52.280304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:52.280775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:52.281200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:52.281869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:52.282344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:52.282767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:52.505096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:52.512675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5480bc81-c80b-477e-81a3-d5c7c3f9b9d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.243564 Sep 01 08:45:52.513227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2435/4895] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:52 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:53.532840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:53.533447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:53.540120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:53.540592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:53.541024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:53.541695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:53.542141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:53.542585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:53.652580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:53.660548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bd1886bb-2463-45c9-8998-2bcddfd3a144 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.131075 Sep 01 08:45:53.661103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2461/4896] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:53 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:54.681453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:54.682053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:54.688063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:54.688532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:54.688956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:54.689624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:54.690353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:54.690768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:54.751946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:54.759520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e8672b9c-8196-4118-a92d-bf05825f6119 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081901 Sep 01 08:45:54.760068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2436/4897] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:54 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:55.780644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:55.781249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:55.783237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:45:55.783381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:45:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 (ip 10.222.0.43) !!! Sep 01 08:45:55.789690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:55.790164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:55.790615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:55.791293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:55.791744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:55.792167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:55.856072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:55.864226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f9c81bfd-cf3e-4ccb-b29e-0fb554b2a01b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.087431 Sep 01 08:45:55.864777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2462/4898] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:55 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:56.884796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:56.885328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:56.891379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:56.891862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:56.892291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:56.892968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:56.893414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:56.893841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:56.953028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:56.960958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e06cf269-9c2b-4681-afed-20b79950153e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080051 Sep 01 08:45:56.961785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2437/4899] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:56 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:57.981809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:57.982436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:57.988814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:57.989288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:57.989713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:57.990413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:57.990860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:57.991277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:58.050190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:58.059134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d36ab59-68d0-4935-a260-1e7171eaa4bb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081108 Sep 01 08:45:58.059684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2463/4900] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:57 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:45:59.080400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:45:59.081174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:45:59.087263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:59.087746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:59.088176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:59.088862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:45:59.089308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:45:59.089727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:45:59.150367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:45:59.157921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d260fa4-093e-4b0b-89cd-01ef4c44b7af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081349 Sep 01 08:45:59.158506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2438/4901] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:45:59 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:00.178758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:00.179362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:00.185230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:00.185707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:00.186137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:00.186842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:00.187293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:00.187712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:00.251031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:00.259381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02ef8495-2cd7-453d-a50d-144a28e97c19 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085151 Sep 01 08:46:00.259940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2464/4902] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:00 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:01.279826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:01.280431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:01.287239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:01.287722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:01.288153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:01.288834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:01.289280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:01.289698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:01.350040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:01.357612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b56cc138-4e1d-450e-9c63-a37182fdb69b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081590 Sep 01 08:46:01.358168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2439/4903] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:01 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:02.378665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:02.379299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:02.385176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:02.385647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:02.386069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:02.386761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:02.387204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:02.387617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:02.447647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:02.455118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33295b84-6666-434f-b1d3-e86236b26f71 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080310 Sep 01 08:46:02.455671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2465/4904] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:02 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:46:03.477027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:03.477629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:03.483561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:03.484034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:03.484683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:03.485359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:03.485801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:03.486212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:03.545656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:03.553883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-287f2a5d-0d7c-4781-b800-110b9a392b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081496 Sep 01 08:46:03.554468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2440/4905] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:03 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:04.624560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:04.625170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:04.631137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:04.631614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:04.632044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:04.632717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:04.633185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:04.633584 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:04.696314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:04.704006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9b68eae1-7cfd-4e48-bd85-80ea0d5c4f59 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.132360 Sep 01 08:46:04.704565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2466/4906] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:04 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:05.725689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:05.726232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:05.732569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:05.733041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:05.733470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:05.734144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:05.734615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:05.735029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:05.798399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:05.806867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-68548a5f-fd81-4a0c-a252-9d6b5880036a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085818 Sep 01 08:46:05.807443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2441/4907] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:05 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:06.827759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:06.828369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:06.834376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:06.834849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:06.835273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:06.835945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:06.836389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:06.836805 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:06.896433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:06.904154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-95f6697d-401e-4e99-a38c-58dacbd0d16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080254 Sep 01 08:46:06.904751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2467/4908] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:06 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:07.924695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:07.925358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:07.931482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:07.931962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:07.932398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:07.933079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:07.933531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:07.933953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:07.993404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:08.000979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e23e5af5-83e0-4cbb-bddb-369ec8afb098 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080128 Sep 01 08:46:08.001542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2442/4909] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:07 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:09.022125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:09.022741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:09.028697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:09.029175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:09.029606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:09.030319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:09.030750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:09.031168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:09.094801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:09.102531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5dbd9377-fb1e-485a-a83a-5bfa607c3d97 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084413 Sep 01 08:46:09.103089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2468/4910] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:09 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:10.123996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:10.124670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:10.131423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:10.131902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:10.132334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:10.133015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:10.133463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:10.133884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:10.193372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:10.201632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b33179a7-70f6-4dad-9cf0-2c5974d7da78 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081796 Sep 01 08:46:10.202213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2443/4911] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:10 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:11.223421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:11.224030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:11.229890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:11.230406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:11.230838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:11.231521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:11.231965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:11.232386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:11.291130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:11.298655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-430932a8-f1b2-4dc1-9791-5f73da091862 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079794 Sep 01 08:46:11.299213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2469/4912] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:11 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:12.319191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:12.319792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:12.325755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:12.326221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:12.326681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:12.327353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:12.327796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:12.328211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:12.387075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:12.394529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-39949e82-9652-4535-9392-ad1ca0d0995b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079260 Sep 01 08:46:12.395113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2444/4913] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:12 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:13.415181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:13.415771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:13.421817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:13.422329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:13.422766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:13.423445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:13.423890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:13.424312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:13.489870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:13.497625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9db31a46-55ea-465c-a90a-2b709800f779 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086442 Sep 01 08:46:13.498199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2470/4914] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:13 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:14.518142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:14.518813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:14.524818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:14.525284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:14.525710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:14.526405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:14.526847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:14.527260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:14.588171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:14.595754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6bec6341-7b2b-4eee-8226-45444e746cca tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081407 Sep 01 08:46:14.596316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2445/4915] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:14 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:15.616843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:15.617658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:15.619435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:15.624647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:15.625120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:15.625541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:15.626224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:15.626699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:15.627110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:15.630447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:15.691129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:15.699410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7af4709c-ff70-467b-b27b-8804cfeb53c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086406 Sep 01 08:46:15.699961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2471/4916] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:15 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:16.720658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:16.721233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:16.724184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:16.728054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:16.728538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:16.728968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:16.729650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:16.730096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:16.730548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:16.733656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:16.791677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:16.799213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-13115cbf-8ccd-4026-9947-b977babd4d35 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082421 Sep 01 08:46:16.799772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2446/4917] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:16 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:17.821332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:17.821939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:17.827783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:17.828252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:17.828676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:17.829374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:17.829811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:17.830225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:17.892201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:17.900531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-146b4429-bd64-4b6a-8561-fd72c1279fd2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082972 Sep 01 08:46:17.901079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2472/4918] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:17 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:18.920823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:18.921428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:18.927383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:18.927852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:18.928279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:18.928944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:18.929388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:18.929797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:18.989185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:18.996671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7731f536-5d11-4503-9e28-f0d10fda18bd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.079673 Sep 01 08:46:18.997230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2447/4919] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:18 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:20.016841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:20.017449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:20.023651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:20.024123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:20.024548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:20.025241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:20.025705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:20.026124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:20.086117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:20.093745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0603d355-1f3d-4c3d-801d-e5321d52db67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080727 Sep 01 08:46:20.094319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2473/4920] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:20 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:21.115649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:21.116255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:21.122186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:21.122697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:21.123125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:21.123810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:21.124255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:21.124672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:21.185275 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:21.193878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4f977d8-8fb1-4c27-a9b7-3db0f1f3ee79 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082663 Sep 01 08:46:21.194465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2448/4921] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:21 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:22.214278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:22.214883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:22.220766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:22.221238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:22.221671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:22.222365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:22.223317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:22.223731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:22.284298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:22.292642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5d5ea9fc-457d-4244-9f82-fe80be609f88 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082227 Sep 01 08:46:22.293195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2474/4922] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:22 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:23.312983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:23.313704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:23.316027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:46:23.319531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 (ip 10.222.0.43) !!! Sep 01 08:46:23.326518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:23.326999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:23.327424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:23.328115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:23.328560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:23.328998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:23.392071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:23.400878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5bd41018-ac0c-452f-b7d0-704f2e35099b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.091467 Sep 01 08:46:23.402023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2449/4923] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:23 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:24.421381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:24.421984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:24.423969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:46:24.424109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:46:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 (ip 10.222.0.43) !!! Sep 01 08:46:24.430855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:24.431338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:24.431769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:24.432448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:24.432897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:24.433316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:24.495536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:24.503075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-087a02d2-0f34-4dc8-bfa3-23261412cb98 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085517 Sep 01 08:46:24.503627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2475/4924] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:24 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:25.523854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:25.524458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:25.530647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:25.531125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:25.531556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:25.532237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:25.532684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:25.533140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:25.597844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:25.605583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2f8025cf-a425-47b9-9495-f63d3e3f8d1b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085582 Sep 01 08:46:25.606173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2450/4925] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:25 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:26.626875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:26.627526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:26.634111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:26.634555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:26.634983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:26.635675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:26.636170 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:26.636579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:26.698921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:26.711542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0306cfbe-7379-42b3-b524-1e61c1fb63d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086459 Sep 01 08:46:26.712528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2476/4926] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:26 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:27.731663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:27.732201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:27.738865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:27.739345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:27.739772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:27.740451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:27.740888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:27.741300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:27.800492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:27.808479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3f23629a-1cbf-4b69-8f80-c7f5ad864907 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080754 Sep 01 08:46:27.809059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2451/4927] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:27 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:28.829928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:28.830575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:28.836574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:28.837052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:28.837478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:28.838154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:28.838624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:28.839044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:28.902612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:28.910935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b5991d45-43a1-4544-b56f-d399b7d4f7ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084808 Sep 01 08:46:28.911494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2477/4928] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:28 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:29.930991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:29.931613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:29.937565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:29.938043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:29.938511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:29.939466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:29.939916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:29.940334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:30.000025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:30.007887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93e3abc0-cf61-47d5-bbc7-371404eb56b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080716 Sep 01 08:46:30.008450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2452/4929] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:29 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:31.028372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:31.028976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:31.035852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:31.036341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:31.036773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:31.037482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:31.037925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:31.038375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:31.242912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:31.250482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f9bbfbca-7700-48b8-88d1-8af17915355b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.225841 Sep 01 08:46:31.250975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2478/4930] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:31 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:32.271862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:32.272471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:32.278538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:32.279014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:32.279443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:32.280118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:32.280572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:32.280991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:32.341344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:32.349484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-52c75776-ee16-46a6-8acc-103ffff639cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082126 Sep 01 08:46:32.350038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2453/4931] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:32 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:33.370187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:33.370819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:33.376815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:33.377289 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:33.377717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:33.378420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:33.379433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:33.379852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:33.438699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:33.447292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b1983fad-293d-463d-a944-04c3df3072aa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080848 Sep 01 08:46:33.447855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2479/4932] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:33 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:34.468301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:34.468899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:34.475817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:34.476294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:34.476727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:34.477400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:34.477841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:34.478277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:34.539984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:34.547562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48ea28bd-26d3-4313-b6df-67fa283cd25a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083111 Sep 01 08:46:34.548118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2454/4933] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:34 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:35.572490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:35.572490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:35.576634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:35.577165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:35.577724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:35.578502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:35.578991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:35.579444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:35.641844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:35.650607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-89ab10e3-d445-40ac-a236-68471015c4c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086229 Sep 01 08:46:35.651173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2480/4934] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:35 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:46:36.671281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:36.671814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:36.677914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:36.678419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:36.678855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:36.679530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:36.679987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:36.680398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:36.740777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:36.748426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1da2901d-6a1d-47ed-9e59-74d07b2cb405 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081117 Sep 01 08:46:36.748987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2455/4935] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:36 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:37.768112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:37.768640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:37.777004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:37.777488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:37.777921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:37.778649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:37.779095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:37.779514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:37.839785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:37.847959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7fc8493c-e204-40c3-9609-ecccfc395776 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083222 Sep 01 08:46:37.848518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2481/4936] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:37 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:38.868694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:38.869854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:38.875452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:38.875935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:38.876368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:38.877055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:38.877507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:38.877931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:38.938495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:38.947077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24e7d8e5-b2e1-4396-ae30-30bd9b0ca19d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082179 Sep 01 08:46:38.947643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2456/4937] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:38 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:39.967620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:39.968228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:39.975634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:39.976120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:39.976558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:39.977256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:39.977709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:39.978129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:40.040676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:40.048453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b44f171-0db3-4a5e-a3c3-9a5fef092000 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084664 Sep 01 08:46:40.049021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2482/4938] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:39 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:41.069633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:41.070302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:41.076330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:41.076826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:41.077262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:41.077956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:41.078455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:41.078869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:41.140581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:41.148895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f9c7a44e-8f53-4b43-9af5-ea3aa32a499c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083445 Sep 01 08:46:41.149484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2457/4939] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:41 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:42.171876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:42.172514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:42.182168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:42.182675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:42.183104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:42.183788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:42.184238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:42.184657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:42.245237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:42.253010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13b58a94-9485-4986-bc28-9ef1b17d481e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086957 Sep 01 08:46:42.254407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2483/4940] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:42 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:43.275316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:43.277798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:43.285621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:43.286171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:43.286634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:43.287329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:43.287780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:43.288198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:43.357822 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:43.366469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2c0b09f8-0ce6-4ab2-bf30-f79a0b2a3735 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.095606 Sep 01 08:46:43.367052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2458/4941] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:43 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:44.394250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:44.394885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:44.401107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:44.401583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:44.402014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:44.402726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:44.403174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:44.403589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:44.467470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:44.476075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3d54b9aa-ae02-47d9-822b-09bd4ddd2261 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085665 Sep 01 08:46:44.476644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2484/4942] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:44 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:45.496284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:45.496803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:45.502718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:45.503194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:45.503626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:45.504299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:45.505289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:45.505722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:45.570213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:45.578054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-37a01579-ad70-45f9-8305-b867fe13e174 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085617 Sep 01 08:46:45.578663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2459/4943] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:45 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:46.599036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:46.599636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:46.601466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:46.606717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:46.607287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:46.607741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:46.608445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:46.608898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:46.609327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:46.612150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:46.670385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:46.677954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-587f60ab-2d1e-42b1-9307-3ab89fc16c50 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083398 Sep 01 08:46:46.678543 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2485/4944] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:46 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:47.699862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:47.700458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:47.702324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:47.707285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:47.708516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:47.708798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:47.709489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:47.709932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:47.710382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:47.713371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:47.772800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:47.780894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-631c4563-cbf6-4bb2-9cdc-58e7425752f9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084857 Sep 01 08:46:47.781455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2460/4945] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:47 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:48.802426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:48.803124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:48.808987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:48.809460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:48.809886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:48.810587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:48.811028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:48.811440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:48.873811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:48.882066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3ac97aa-a8fc-46cf-8d50-e21a8fbc31d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084100 Sep 01 08:46:48.882657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2486/4946] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:48 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:49.902422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:49.903023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:49.909249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:49.909890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:49.910391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:49.911217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:49.911666 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:49.912271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:49.974631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:49.982387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3f69f1c4-332b-437c-87e8-ee4a8ad9d8b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083674 Sep 01 08:46:49.982980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2461/4947] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:49 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:51.003146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:51.003904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:51.010633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:51.011116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:51.011554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:51.012244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:51.012690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:51.013108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:51.072878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:51.080490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac612ebd-0828-48c2-aa84-274c1428f8c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081089 Sep 01 08:46:51.081049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2487/4948] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:50 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:52.100220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:52.100821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:52.106688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:52.107158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:52.107586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:52.108255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:52.108696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:52.109109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:52.168813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:52.176310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e866c53-3f05-44e3-a130-9ae62e314f4a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080136 Sep 01 08:46:52.176883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2462/4949] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:52 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:53.197079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:53.197623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:53.203671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:53.204175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:53.204605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:53.205276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:53.205718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:53.206128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:53.269727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:53.277903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf48eb42-ef17-488b-8c67-baf2a3f6342d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085358 Sep 01 08:46:53.278608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2488/4950] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:53 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:54.298586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:54.299306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:54.305450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:54.305941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:54.306400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:54.307099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:54.307546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:54.307964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:54.368502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:54.375935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ec0a1649-2ca2-4bc9-a04f-6fd989d5d36e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081252 Sep 01 08:46:54.376496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2463/4951] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:54 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:55.398487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:55.399091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:55.405058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:55.405534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:55.405965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:55.406669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:55.407112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:55.407532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:55.467745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:55.475454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ad9736aa-d75a-4f07-937d-39bb9a0a0135 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080793 Sep 01 08:46:55.476023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2489/4952] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:55 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:56.495876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:56.496505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:56.502447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:56.502933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:56.503363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:56.504037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:56.505105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:56.505568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:56.564889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:56.574363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-97b13041-dc95-4b68-9916-e0b108d6574e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082009 Sep 01 08:46:56.574962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2464/4953] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:56 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:57.599423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:57.600018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:57.606028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:57.606539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:57.606973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:57.607649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:57.608104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:57.608522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:57.671238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:57.679572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b593e4e8-3a63-415a-a739-63fbf0df6b58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084604 Sep 01 08:46:57.680138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2490/4954] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:57 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:58.701338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:58.701943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:58.708586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:58.709067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:58.709490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:58.710183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:58.710652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:58.711067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:58.772750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:58.780368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-00b0e565-9dab-4066-ac55-00650b51257d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082851 Sep 01 08:46:58.780926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2465/4955] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:58 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:46:59.800250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:46:59.800866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:46:59.807111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:59.807596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:59.808063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:59.808754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:46:59.809206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:46:59.809646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:46:59.873983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:46:59.881641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce45d1e1-cd22-4693-841b-679da8e6fdc2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085406 Sep 01 08:46:59.882207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2491/4956] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:46:59 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:00.901783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:00.902418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:00.908426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:00.908906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:00.909334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:00.910008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:00.910483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:00.910929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:00.972541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:00.980935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d96d8d8d-a8f4-48a2-af0a-a771075d5175 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082900 Sep 01 08:47:00.981502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2466/4957] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:00 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:02.002035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:02.002667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:02.009297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:02.009777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:02.010207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:02.010903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:02.011348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:02.011764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:02.073598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:02.081168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2bcb7a48-ef6f-4634-96ce-36e3caca927e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.082963 Sep 01 08:47:02.081720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2492/4958] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:01 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:03.103128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:03.103767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:03.109672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:03.110148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:03.110614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:03.111290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:03.111738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:03.112159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:03.173881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:03.181648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2b9e9b0d-4a85-4009-b562-32cfecc0ad18 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.083211 Sep 01 08:47:03.182201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2467/4959] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:03 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:04.201926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:04.202546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:04.208469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:04.208948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:04.209375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:04.210043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:04.210509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:04.210926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:04.270851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:04.278290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fd2199f1-4ea1-45bf-b8f7-040ea990c708 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.080188 Sep 01 08:47:04.278852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2493/4960] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:04 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:05.302204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:05.302861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:05.308786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:05.309261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:05.309691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:05.310397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:05.310845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:05.311262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:05.371721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:05.379230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd8e1445-6bb9-4e0d-8aeb-f18b3bd742c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.081327 Sep 01 08:47:05.380441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2468/4961] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:05 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:06.399384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:06.400062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:06.406162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:06.406673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:06.407107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:06.407792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:06.408248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:06.408669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:06.471164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:06.480341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c8b5293d-dfe1-4bc3-923c-78c0eda62364 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.084892 Sep 01 08:47:06.480903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2494/4962] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:06 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:07.501192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:07.501729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:07.508292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:07.508765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:07.509188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:07.509858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:07.510320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:07.510735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:07.571170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:07.584208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7733963e-3366-48e6-96d0-01ab290a7dc5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.086730 Sep 01 08:47:07.584785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2469/4963] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:07 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:08.605227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:08.605828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:08.611704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:08.612178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:08.612609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:08.613291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:08.614407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:08.614925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:08.679048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:08.686670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c95f35f-a034-4c1e-a609-2daac3b7d54e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 200 len: 1218 microversion: 2.1 time: 0.085265 Sep 01 08:47:08.687234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2495/4964] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:08 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:08.706273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:08.706787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:08.712783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:08.713260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:08.713690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:08.714432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:08.714887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:08.715306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:08.740530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Going to try to terminate instance {{(pid=120752) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:47:08.749757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:08.750228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:08.750684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:08.763184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lazy-loading 'flavor' on Instance uuid 0932a718-170c-4d44-8848-eb12a62d5348 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:47:08.774805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lazy-loading 'system_metadata' on Instance uuid 0932a718-170c-4d44-8848-eb12a62d5348 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:47:08.791538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.objects.instance [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lazy-loading 'metadata' on Instance uuid 0932a718-170c-4d44-8848-eb12a62d5348 {{(pid=120752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:47:08.952668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.scheduler.client.report [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Deleted allocations for instance 0932a718-170c-4d44-8848-eb12a62d5348 Sep 01 08:47:08.969031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cdb77d06-9de4-4056-ab3a-d1a9b79e1f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 204 len: 0 microversion: 2.1 time: 0.266491 Sep 01 08:47:08.969637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2470/4965] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:47:08 2022] DELETE /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:47:08.978150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:08.978817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 0932a718-170c-4d44-8848-eb12a62d5348] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:08.984653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:08.985066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:08.985490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:08.986154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:08.986622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:08.987038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:08.999989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.wsgi [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] HTTP exception thrown: Instance 0932a718-170c-4d44-8848-eb12a62d5348 could not be found. Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Request method failure captured: Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: request: GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 HTTP/1.1 Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept: application/json Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Accept-Encoding: identity Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Connection: close Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Length: 0 Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Content-Type: application/json Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Host: 10.222.0.43 Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Openstack-System-Scope: None Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: User-Agent: python-urllib3/1.26.12 Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Auth-Token: gAAAAABjEHAgOMkDDQz21q81UWYvZqd_AOfJ4vZjZoa0N_oDNOXZZ7xEkEzDF5XPVAKZbeUuzS-qnfQoTfghqbbkymfLTcS4MVVsaHgyPx_dYw_hXx-rNhgd2EaR1O54Gk9Y88FM2aPXntG0Fd_BKn14_1kZIoDOhd4TZZGEbaAB_kxfXihCldY Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Id: None Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Domain-Name: None Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Identity-Status: Confirmed Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Is-Admin-Project: True Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Id: default Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Domain-Name: Default Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Id: 25b100830711488eaccc36e6452e393b Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Project-Name: tempest-VolumesActionsTest-1507503638 Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Role: reader,member Sep 01 08:47:09.001451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Roles: reader,member Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25b100830711488eaccc36e6452e393b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25b100830711488eaccc36e6452e393b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25b100830711488eaccc36e6452e393b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25b100830711488eaccc36e6452e393b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant: tempest-VolumesActionsTest-1507503638 Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Id: 25b100830711488eaccc36e6452e393b Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-Tenant-Name: tempest-VolumesActionsTest-1507503638 Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User: tempest-VolumesActionsTest-1507503638-project Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Id: default Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Domain-Name: Default Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Id: b3b80c8db57f466ab4260d2a2774d96c Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: X-User-Name: tempest-VolumesActionsTest-1507503638-project Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: method: > Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: exception: Instance 0932a718-170c-4d44-8848-eb12a62d5348 could not be found. Sep 01 08:47:09.003005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: action_args: {'id': '0932a718-170c-4d44-8848-eb12a62d5348'} Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0932a718-170c-4d44-8848-eb12a62d5348 could not be found. Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:47:09.003830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0932a718-170c-4d44-8848-eb12a62d5348 could not be found. Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0932a718-170c-4d44-8848-eb12a62d5348 could not be found. Sep 01 08:47:09.005398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: ERROR nova.api.openstack.wsgi Sep 01 08:47:09.006704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Returning 404 to user: Instance 0932a718-170c-4d44-8848-eb12a62d5348 could not be found. {{(pid=120753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:47:09.006704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8c6e90fe-7b4c-418e-817e-4bbb1d28ea3f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348" status: 404 len: 111 microversion: 2.1 time: 0.028445 Sep 01 08:47:09.006704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2496/4966] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:08 2022] GET /compute/v2.1/servers/0932a718-170c-4d44-8848-eb12a62d5348 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:47:09.119271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1939364160", "imageRef": "1479509d-0c89-41bc-80b5-1d62c8de9267", "flavorRef": "452", "networks": [{"uuid": "46a9c68a-8627-454e-978d-23ace008964c"}]}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:47:09.172112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] validate_networks() for [('46a9c68a-8627-454e-978d-23ace008964c', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:47:09.581336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:47:09.581750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:47:09.583101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:47:09.583511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:47:09.583914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:47:09.592462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:09.592930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:09.593351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:09.594053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:09.594544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:09.594958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:09.611027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Getting quotas for project 25b100830711488eaccc36e6452e393b. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:47:09.615522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Getting quotas for user b3b80c8db57f466ab4260d2a2774d96c and project 25b100830711488eaccc36e6452e393b. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:47:09.625977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:47:09.628100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1479509d-0c89-41bc-80b5-1d62c8de9267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:47:09.675629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-adc89615-51fa-41f7-b7a2-392322a2af3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560118 Sep 01 08:47:09.676902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2471/4967] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:47:09.687601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6ccfaf82-e77b-45aa-895e-3a1c37dfe649 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:09.688473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6ccfaf82-e77b-45aa-895e-3a1c37dfe649 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:09.745134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ccfaf82-e77b-45aa-895e-3a1c37dfe649 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:09.752232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6ccfaf82-e77b-45aa-895e-3a1c37dfe649 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1214 microversion: 2.1 time: 0.068371 Sep 01 08:47:09.752792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2497/4968] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:10.773343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:10.773897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:10.780604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:10.781089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:10.781527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:10.782201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:10.782677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:10.783100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:10.844074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:10.852481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb92bebc-d10d-4402-a06b-cedccb5cee04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083328 Sep 01 08:47:10.853036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2472/4969] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:10 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:11.872852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:11.873449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:11.880375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:11.881197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:11.881914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:11.882860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:11.883319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:11.884030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:11.950224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:11.958371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-291e2d86-4db9-4aa0-a586-81a7c26be538 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.089201 Sep 01 08:47:11.959066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2498/4970] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:11 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:12.980496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:12.981100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:12.986975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:12.987449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:12.987873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:12.989353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:12.989827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:12.990227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:12.994109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:13.050427 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:13.058647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-671da376-77b5-477a-b172-f3c9326ccfac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081948 Sep 01 08:47:13.059200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2473/4971] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:12 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:47:14.079576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:14.080174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:14.086389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:14.086868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:14.087296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:14.088029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:14.088475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:14.088893 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:14.152294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:14.160026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e90d8d6c-6168-4ff8-8446-143bd51c71d3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084256 Sep 01 08:47:14.161269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2499/4972] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:14 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:15.181411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:15.182007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:15.187855 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:15.188594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:15.189021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:15.189690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:15.190131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:15.190588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:15.250871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:15.258560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3ab578e-2bc0-47df-baf3-c9fd9e4fdc2b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081003 Sep 01 08:47:15.259114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2474/4973] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:15 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:16.279143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:16.279748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:16.285938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:16.286461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:16.286896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:16.287574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:16.288021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:16.288444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:16.349845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:16.357401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0108e192-79b8-48a5-9d24-998818a4ff52 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082238 Sep 01 08:47:16.358041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2500/4974] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:16 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:17.378133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:17.378763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:17.385183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:17.385658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:17.386082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:17.386785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:17.387225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:17.387637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:17.447751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:17.455298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e28118e3-c05c-4f47-bf1e-961b339423b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080978 Sep 01 08:47:17.455846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2475/4975] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:17 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:18.476164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:18.476776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:18.478781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=34 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:18.484261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:18.484740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:18.485169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:18.485854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:18.486320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:18.486739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:18.489593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=86 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:18.550533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:18.558228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e57a0a7-a7e2-448e-93dd-b3c12a29d278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.086328 Sep 01 08:47:18.558796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2501/4976] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:18 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:19.580128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:19.580755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:19.583507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:19.588782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:19.589254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:19.589676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:19.590380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:19.590823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:19.591237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:19.607684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:19.622969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=6 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:19.654566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:19.662816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e4b3bfe7-d2e3-480c-92d7-7f30a145809b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.086493 Sep 01 08:47:19.663526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2476/4977] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:19 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:20.683220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:20.683820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:20.685656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:20.691371 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:20.691852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:20.692824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:20.693525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:20.693968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:20.694417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:20.753811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:20.761802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a961d498-7596-4d11-a96a-3a1a2639a32b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082422 Sep 01 08:47:20.762378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2502/4978] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:20 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:21.783240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:21.783842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:21.789740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:21.790217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:21.790674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:21.791353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:21.791800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:21.792219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:21.853044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:21.860586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4f62cc8-f18d-4dd5-a9e6-725b84ec7449 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081218 Sep 01 08:47:21.861172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2477/4979] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:21 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:22.881456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:22.882240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:22.889541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:22.890025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:22.890492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:22.891191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:22.891640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:22.892060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:22.961194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:22.969475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6785f66-93c2-4d6a-b817-2107a15ef0b7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.092490 Sep 01 08:47:22.970026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2503/4980] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:22 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:23.990594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:23.991201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:23.997178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:23.997653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:23.998082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:23.998782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:23.999230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:23.999648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:24.059380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:24.067885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c6f36df6-5b2c-4157-b4ab-248232fcc7a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081084 Sep 01 08:47:24.068554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2478/4981] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:23 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:47:25.088642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:25.089261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:25.095379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:25.095950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:25.096301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:25.097205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:25.097445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:25.097872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:25.158888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:25.167270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9dd50f09-8f0a-4bfc-b5b5-2d9bd81d61fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082425 Sep 01 08:47:25.167828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2504/4982] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:25 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:26.188078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:26.188610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:26.195315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:26.195790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:26.196222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:26.196899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:26.197351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:26.197774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:26.257606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:26.265038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-90d826e2-2082-4eb8-abdb-cb53f1b6de53 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081128 Sep 01 08:47:26.265590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2479/4983] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:26 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:27.285469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:27.286118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:27.292020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:27.292488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:27.292909 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:27.293574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:27.294013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:27.294474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:27.356396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:27.363832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-56c866e1-7b3d-40e5-87fb-37e80b9b1f38 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082274 Sep 01 08:47:27.364418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2505/4984] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:27 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:28.384248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:28.384819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:28.390748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:28.391228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:28.391659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:28.392340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:28.392787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:28.393204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:28.452963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:28.461059 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dc62ebc1-d17b-4414-99d0-e800b9f539a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080708 Sep 01 08:47:28.461618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2480/4985] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:28 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:29.482082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:29.482713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:29.488585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:29.489645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:29.490074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:29.490785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:29.491431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:29.491859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:29.550443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:29.558646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0a8cf1df-3a01-435e-864c-45b78a16b929 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080308 Sep 01 08:47:29.559207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2506/4986] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:29 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:30.579975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:30.580607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:30.587328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:30.587804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:30.588227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:30.588899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:30.589338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:30.589752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:30.649529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:30.657686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd383064-afa7-4c45-82cb-9c6ea2192533 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081540 Sep 01 08:47:30.658236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2481/4987] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:30 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:47:31.678063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:31.678672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:31.684642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:31.685142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:31.685565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:31.686234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:31.686699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:31.687112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:31.752244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:31.760527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b21c308f-510d-4850-b656-190b54840444 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.086315 Sep 01 08:47:31.761076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2507/4988] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:31 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:32.780927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:32.781533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:32.788202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:32.788683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:32.789108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:32.790188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:32.790695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:32.791261 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:32.852572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:32.860133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fd3090ac-209f-40c2-8594-9dbe1b64b527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083074 Sep 01 08:47:32.860685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2482/4989] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:32 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:33.880329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:33.880927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:33.886970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:33.887445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:33.887961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:33.888557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:33.889005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:33.889419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:33.950934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:33.958754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e17ea1d-28e6-4732-9c05-c26014957c7b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082812 Sep 01 08:47:33.959315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2508/4990] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:33 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:34.979202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:34.979820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:34.985694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:34.986165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:34.986628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:34.987302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:34.987745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:34.988157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:35.048216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:35.056312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b4f23163-d08f-4eb1-b974-55bb2fbfde8d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081029 Sep 01 08:47:35.056863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2483/4991] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:34 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:36.076757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:36.077363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:36.083670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:36.084150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:36.084581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:36.085261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:36.085716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:36.086171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:36.148402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:36.155994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f3ffcfef-19cb-4fe8-b166-91fef8584e73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083071 Sep 01 08:47:36.156553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2509/4992] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:36 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:37.176654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:37.177374 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:37.183260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:37.183734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:37.184163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:37.184834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:37.185278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:37.185693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:37.245921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:37.253372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61d5a0b8-d600-4969-87c0-703a654f42c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080530 Sep 01 08:47:37.254169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2484/4993] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:37 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:38.275199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:38.275935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:38.281923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:38.282438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:38.282868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:38.283566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:38.284010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:38.284426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:38.344789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:38.353115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3c4482d0-c7fc-473d-9a47-ce2e5f6ea1c5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082677 Sep 01 08:47:38.353667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2510/4994] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:38 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:39.373991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:39.374617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:39.381035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:39.381509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:39.381935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:39.382631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:39.383079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:39.383488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:39.442430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:39.450832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5522b306-6064-4add-b896-1a0e7ad3f5d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080593 Sep 01 08:47:39.451391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2485/4995] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:39 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:40.471628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:40.472234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:40.478190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:40.478700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:40.479128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:40.479808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:40.480252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:40.480665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:40.543244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:40.550859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e08e517-2b23-4309-ae55-babf9f5ba9a8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083053 Sep 01 08:47:40.551411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2511/4996] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:40 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:41.572653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:41.573260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:41.579512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:41.579999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:41.580429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:41.581119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:41.581566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:41.581989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:41.647198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:41.655303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-029ef378-ff82-4148-ba03-8ea3b50b3db1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.086789 Sep 01 08:47:41.655883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2486/4997] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:41 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:42.676268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:42.676867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:42.683852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:42.684337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:42.684763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:42.685438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:42.685878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:42.686324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:42.746031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:42.753623 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1b33fd5b-a850-42fd-bb57-959b7b984b70 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081137 Sep 01 08:47:42.754179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2512/4998] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:42 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:43.775922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:43.776507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:43.782468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:43.782949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:43.783402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:43.784079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:43.784522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:43.784934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:43.787542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=83 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:43.846733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:43.855207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3963d7e7-a018-404c-9c37-3561c9d01116 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083261 Sep 01 08:47:43.855854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2487/4999] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:43 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:44.876249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:44.876878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:44.883555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:44.884032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:44.884457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:44.885126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:44.885569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:44.885985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:44.948943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:44.956488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b7dbdf55-eb7c-4373-a02b-d553199b178c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084041 Sep 01 08:47:44.957053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2513/5000] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:44 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:45.981299 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:45.982462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:45.988576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:45.989046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:45.989499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:45.990317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:45.990772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:45.991189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:46.197436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:46.205128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9de04fe9-0046-4fa0-b31c-d6e327951079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.228235 Sep 01 08:47:46.205672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2488/5001] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:45 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:47.227204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:47.227806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:47.233664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:47.234144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:47.234616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:47.235291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:47.235740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:47.236162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:47.295958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:47.303400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-03f6f9e7-27b9-44d4-9c6d-7db85ec195f6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080833 Sep 01 08:47:47.303961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2514/5002] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:47 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:48.323945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:48.324560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:48.330624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:48.331097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:48.331524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:48.332190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:48.332635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:48.333067 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:48.391765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:48.399492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d46bda73-9c09-4f9d-8f96-6378722230ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079371 Sep 01 08:47:48.400042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2489/5003] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:48 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:49.420425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:49.421029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:49.422881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:49.428746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:49.429224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:49.429653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:49.430367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:49.430813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:49.431232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:49.433906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:49.492675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:49.500196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1dd2c292-8a11-4e9b-8c2f-96761db45a29 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083643 Sep 01 08:47:49.500750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2515/5004] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:49 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:50.520573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:50.521733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:50.523577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:50.528737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:50.529211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:50.529640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:50.530337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:50.530782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:50.531196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:50.594280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:50.602185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2a82678f-23c7-4c18-b306-f968fc3dc7e5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085536 Sep 01 08:47:50.602804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2490/5005] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:50 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:51.622863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:51.623492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:51.629601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:51.630862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:51.631387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:51.631967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:51.632416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:51.632874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:51.693638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:51.701248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-442229f1-be7c-433b-aa71-a61bcfc04a07 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082335 Sep 01 08:47:51.701816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2516/5006] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:51 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:52.722444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:52.722971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:52.729408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:52.729882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:52.730347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:52.731107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:52.731556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:52.731975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:52.791768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:52.799286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1adbba0-5059-4f1d-a322-7679588b9d9b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080751 Sep 01 08:47:52.799851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2491/5007] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:52 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:53.820067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:53.820673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:53.826987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:53.827468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:53.827891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:53.828634 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:53.829101 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:53.829517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:53.889725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:53.897807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-59ba578e-b9b2-4ad2-9372-cdb715431f63 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081685 Sep 01 08:47:53.898377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2517/5008] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:53 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:54.918692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:54.919323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:54.925420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:54.925902 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:54.926362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:54.927052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:54.927501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:54.928064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:54.995932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:55.003587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7d3b1356-f93a-4b98-945e-752e906e6bde tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.088733 Sep 01 08:47:55.004140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2492/5009] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:54 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:56.024655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:56.025266 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:56.031298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:56.031774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:56.032207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:56.032884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:56.033340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:56.033751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:56.095774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:56.103918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-33d5466c-4053-491f-8ab8-fffbe42f6585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083616 Sep 01 08:47:56.104474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2518/5010] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:56 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:57.124815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:57.125445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:57.131353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:57.132471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:57.132898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:57.133573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:57.134014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:57.134457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:57.194226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:57.201743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a4279e98-6bc0-450b-a113-833d7dc56e54 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080714 Sep 01 08:47:57.202313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2493/5011] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:57 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:58.222182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:58.222845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:58.228693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:58.229167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:58.229592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:58.230274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:58.230724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:58.231136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:58.290126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:58.297605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6fe91aee-dac9-4a24-b46f-9e2dbdc58585 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079285 Sep 01 08:47:58.298159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2519/5012] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:58 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:47:59.320698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:47:59.321328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:47:59.328918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:59.329389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:59.329829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:59.330590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:47:59.331042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:47:59.331460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:47:59.399678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:47:59.407204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1ab108c9-3358-44e8-a808-c1eab2f828f4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.092586 Sep 01 08:47:59.407752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2494/5013] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:47:59 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:00.427823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:00.428552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:00.435520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:00.436001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:00.436433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:00.437378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:00.437831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:00.438282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:00.499088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:00.506777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-20e87ae0-942d-4e34-b3c4-fb39ec132e39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082712 Sep 01 08:48:00.507615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2520/5014] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:00 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:01.528107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:01.528631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:01.534763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:01.535242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:01.535670 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:01.536344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:01.536789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:01.537204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:01.597618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:01.606013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7bedd33b-7de7-4759-aa6f-af0b9026fa80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081815 Sep 01 08:48:01.606613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2495/5015] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:01 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:48:02.626624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:02.627228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:02.633606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:02.634084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:02.634541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:02.635227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:02.635671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:02.636090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:02.696430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:02.704006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-35aa0ddb-b871-4389-b386-7ae4565267f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081218 Sep 01 08:48:02.704770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2521/5016] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:02 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:03.725160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:03.726532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:03.733066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:03.733541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:03.733971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:03.734676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:03.735125 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:03.735543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:03.797749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:03.805405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f9eab0c1-8eb4-4e55-aa44-e6c7c41d0b10 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084177 Sep 01 08:48:03.805957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2496/5017] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:03 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:04.825384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:04.825987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:04.832226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:04.832698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:04.833125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:04.833794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:04.834237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:04.834674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:04.894867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:04.902423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f53afc2c-5142-495b-b178-5eb2db305104 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080876 Sep 01 08:48:04.902980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2522/5018] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:04 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:05.923199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:05.923742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:05.929879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:05.930392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:05.930821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:05.931494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:05.931936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:05.932351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:05.992522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:06.000056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-af287fc1-97f7-4b8a-8269-c5c2b5df919f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080753 Sep 01 08:48:06.000612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2497/5019] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:05 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:07.020443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:07.020969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:07.027359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:07.027835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:07.028284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:07.028966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:07.029439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:07.029852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:07.089734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:07.097102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2cdea9a5-f53d-4586-ad09-a074bb17fe92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080610 Sep 01 08:48:07.097648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2523/5020] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:07 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:08.120944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:08.121562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:08.128457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:08.128948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:08.129386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:08.130082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:08.130568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:08.131037 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:08.203165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:08.212328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-efea7b76-837a-4375-b149-4fca07c76a80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.096987 Sep 01 08:48:08.212887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2498/5021] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:08 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:09.232742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:09.233352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:09.239307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:09.239791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:09.240223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:09.240899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:09.242116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:09.242720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:09.304841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:09.312706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bae4cc9c-1bd6-4bda-94ce-7cc818f45470 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083869 Sep 01 08:48:09.313265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2524/5022] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:10.333223 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:10.333834 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:10.340403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:10.340884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:10.341312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:10.341991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:10.342471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:10.342890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:10.402333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:10.409882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-040279b4-c856-404e-8d35-c536fd13a195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080631 Sep 01 08:48:10.410599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2499/5023] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:10 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:11.430695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:11.431297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:11.437410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:11.437884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:11.438336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:11.439010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:11.439454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:11.439864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:11.499226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:11.507236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-122df385-08b7-4c16-8c49-4257a8d9138e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079857 Sep 01 08:48:11.507825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2525/5024] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:11 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:12.527829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:12.528430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:12.534277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:12.534749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:12.535182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:12.535850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:12.536288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:12.536702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:12.598121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:12.606335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cbedca87-4fea-4a54-99f0-f912e5967977 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082318 Sep 01 08:48:12.606884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2500/5025] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:12 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:13.626507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:13.627139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:13.633697 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:13.634168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:13.634625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:13.635294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:13.635740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:13.636160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:13.696210 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:13.703668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-10983d06-b8bb-4d0d-a944-06a8e04b8d20 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081000 Sep 01 08:48:13.704212 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2526/5026] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:13 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:14.726782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:14.727304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:14.733373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:14.733851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:14.734308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:14.734995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:14.735443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:14.735864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:14.738384 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:14.795704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:14.803158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c9589a86-6979-4a57-880c-2eebda9ed1d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080368 Sep 01 08:48:14.804337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2501/5027] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:14 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:15.824387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:15.824941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:15.830963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:15.831435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:15.831857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:15.832528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:15.832967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:15.833381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:15.893004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:15.901182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1cbeac12-ff75-447c-9b57-82dab2528e3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080715 Sep 01 08:48:15.901732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2527/5028] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:15 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:16.921630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:16.922290 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:16.928817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:16.929358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:16.929794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:16.930509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:16.930962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:16.931388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:16.993327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:17.000936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5685e67a-b514-4cf0-8c29-26b697ccfba2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083136 Sep 01 08:48:17.001488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2502/5029] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:16 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:18.021796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:18.022732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:18.028462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:18.028938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:18.029368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:18.030051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:18.030528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:18.030951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:18.091678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:18.099228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-52e635b2-ff10-4d3e-99af-6ed3a9bd3a2d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081891 Sep 01 08:48:18.099781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2528/5030] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:18 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:19.120993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:19.121643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:19.127519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:19.127988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:19.128408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:19.129073 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:19.129545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:19.129958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:19.189365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:19.197471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-286b4255-b74d-4f2d-abaf-d29111dbaf62 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080407 Sep 01 08:48:19.198019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2503/5031] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:19 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:20.217385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:20.217916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:20.219777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:20.225034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:20.225510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:20.225940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:20.227494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:20.227977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:20.228399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:20.231284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:20.287850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:20.296003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-007f7479-d6ab-4fda-babf-f58ca85a9224 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082497 Sep 01 08:48:20.296556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2529/5032] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:20 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:21.316618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:21.317227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:21.319084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:21.324509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:21.324989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:21.325423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:21.326104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:21.326584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:21.327010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:21.389471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:21.396974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5adbfe59-4024-412a-872f-1f15e53f339e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084188 Sep 01 08:48:21.397527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2504/5033] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:21 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:22.417463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:22.418037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:22.423975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:22.424446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:22.424879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:22.425553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:22.426001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:22.426464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:22.486287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:22.494655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-63ecc1e4-e4f8-4b48-81d5-e183bac482b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081069 Sep 01 08:48:22.495209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2530/5034] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:22 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:23.514646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:23.515254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:23.521095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:23.521560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:23.521984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:23.522669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:23.523937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:23.524352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:23.582763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:23.590835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bc37147e-f5cf-4727-8bfc-03075b253610 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079978 Sep 01 08:48:23.591385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2505/5035] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:23 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:24.611167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:24.611775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:24.617688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:24.618160 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:24.618699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:24.619377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:24.619831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:24.620247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:24.679507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:24.687261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-07e34b1d-c35d-4afc-9546-c07840b967f5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079906 Sep 01 08:48:24.687811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2531/5036] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:24 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:48:25.767741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:25.768348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:25.774503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:25.774978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:25.775406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:25.776080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:25.776526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:25.776947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:25.838479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:25.845851 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a9f5b7f3-8fb8-4585-9867-f0d654468fab tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081962 Sep 01 08:48:25.846429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2506/5037] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:25 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:26.866905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:26.867823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:26.873734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:26.874213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:26.874678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:26.875359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:26.875806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:26.876226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:26.935566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:26.943317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-676047ea-66a0-4ccd-9699-3e6898034ac7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080762 Sep 01 08:48:26.943866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2532/5038] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:26 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:27.964053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:27.964661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:27.970662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:27.971140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:27.971572 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:27.972246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:27.972694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:27.973115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:28.031814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:28.039926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ca3cc500-eb24-40fd-b2f8-dba57a3bb100 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079727 Sep 01 08:48:28.040477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2507/5039] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:27 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:29.060407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:29.061052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:29.067242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:29.067717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:29.068145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:29.068817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:29.069263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:29.069796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:29.132665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:29.140407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5d55ae87-1a12-40a9-a9a0-ed6eb7e20e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083776 Sep 01 08:48:29.140973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2533/5040] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:29 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:30.160850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:30.161439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:30.167930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:30.168402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:30.168836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:30.169512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:30.169958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:30.170405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:30.232124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:30.239584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-069d84ae-bafe-4fd7-b00c-256030efc90a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082547 Sep 01 08:48:30.240134 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2508/5041] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:30 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:31.260528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:31.261129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:31.266993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:31.267466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:31.267891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:31.268556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:31.268995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:31.269410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:31.328213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:31.336010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e1d030f5-124e-4ed2-8f5b-ca23297a242c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079939 Sep 01 08:48:31.336561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2534/5042] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:31 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:32.356142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:32.356775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:32.362654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:32.363138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:32.363565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:32.364240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:32.364695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:32.365113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:32.423397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:32.431658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48607cea-e0a0-4f99-bd14-e9cc07cd707f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079333 Sep 01 08:48:32.432222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2509/5043] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:32 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:33.452457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:33.453059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:33.458889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:33.459390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:33.459820 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:33.460992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:33.461432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:33.461849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:33.519937 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:33.527917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b1e358c1-bf29-4c74-a860-d3d34481e32e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079252 Sep 01 08:48:33.528462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2535/5044] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:33 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:34.548622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:34.549224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:34.555089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:34.555541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:34.555969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:34.556638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:34.557222 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:34.557491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:34.618970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:34.626347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0e7e99df-544b-4149-b768-e2b0902f8a48 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081447 Sep 01 08:48:34.626895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2510/5045] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:34 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:35.648080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:35.648594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:35.654375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:35.654849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:35.655275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:35.655944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:35.656384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:35.656795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:35.715424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:35.723054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d6ca3e3d-4cd9-417b-9a8a-c35fa6ba255a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079480 Sep 01 08:48:35.723636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2536/5046] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:35 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:36.742767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:36.743378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:36.749367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:36.749849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:36.750301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:36.750984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:36.751432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:36.751854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:36.811938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:36.819349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-284f422c-8fa7-4ddc-bcf2-f9bae7a162b6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080732 Sep 01 08:48:36.819910 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2511/5047] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:36 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:37.840716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:37.841316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:37.847225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:37.847694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:37.848120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:37.848788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:37.849232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:37.849647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:37.908326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:37.915942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-31814853-c970-47a6-a971-13988d9b1994 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079618 Sep 01 08:48:37.916494 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2537/5048] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:37 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:38.935708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:38.936576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:38.942482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:38.942965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:38.943400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:38.944081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:38.944531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:38.944971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:39.006732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:39.014369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9ef79417-2c05-4b08-80f9-473e73ecf688 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082477 Sep 01 08:48:39.014925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2512/5049] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:38 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:40.035261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:40.035905 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:40.042555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:40.043036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:40.043469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:40.044150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:40.044601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:40.045026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:40.103934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:40.111370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d34610f4-a720-4a21-b97e-06446305b7df tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079974 Sep 01 08:48:40.111927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2538/5050] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:40 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:41.131263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:41.131865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:41.137840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:41.138345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:41.138775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:41.139454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:41.139896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:41.140311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:41.198639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:41.206003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7c413c64-4cc2-4f8e-bac7-8f50c205b4c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078550 Sep 01 08:48:41.206582 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2513/5051] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:41 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:42.226332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:42.227544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:42.233349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:42.233829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:42.234278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:42.234967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:42.235414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:42.235835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:42.294409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:42.301904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7cf7a475-62b6-4ff4-95e9-d7872041ada0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079447 Sep 01 08:48:42.302478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2539/5052] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:42 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:48:43.323780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:43.324395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:43.330296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:43.330780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:43.331212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:43.331892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:43.332340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:43.332759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:43.393723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:43.401270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-708bf6fe-3ed9-4474-81b1-386d55bfe479 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081994 Sep 01 08:48:43.401823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2514/5053] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:43 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:44.421729 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:44.422376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:44.428241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:44.428720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:44.429147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:44.430469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:44.430938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:44.431357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:44.494997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:44.502397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4a85fd8d-9907-4333-8796-5737b546c7dd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084456 Sep 01 08:48:44.502947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2540/5054] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:44 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:45.522751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:45.523355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:45.529202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:45.529703 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:45.530136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:45.530835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:45.531278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:45.531692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:45.534132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:45.593661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:45.601060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-afdcbed9-99f3-49e0-a916-f1dd7dd682d8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082181 Sep 01 08:48:45.601643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2515/5055] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:45 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:46.621649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:46.622308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:46.628154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:46.628630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:46.629060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:46.629735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:46.630181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:46.630625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:46.691846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:46.699955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-740f8996-e400-4db1-a1f2-d822e542a410 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082123 Sep 01 08:48:46.700509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2541/5056] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:46 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:47.721108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:47.721619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:47.728453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:47.728926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:47.729351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:47.730015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:47.730491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:47.730903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:47.792089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:47.799536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4771b91f-875a-465e-a2aa-fe4957730ec7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082345 Sep 01 08:48:47.800092 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2516/5057] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:47 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:48.820097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:48.821426 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:48.827558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:48.828029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:48.828456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:48.829130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:48.829575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:48.829990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:48.890577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:48.898031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-90a49acd-d998-4f4e-9f7b-27f23d3a69ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081967 Sep 01 08:48:48.898625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2542/5058] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:48 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:49.918388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:49.918988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:49.924842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:49.925313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:49.925738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:49.926439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:49.926885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:49.927300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:49.986664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:49.994789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-377f12fe-e83e-454c-a9ab-72a61f95b37d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080311 Sep 01 08:48:49.995347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2517/5059] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:49 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:51.014633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:51.015236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:51.017124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:51.022551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:51.023031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:51.023969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:51.024644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:51.025117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:51.025532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:51.028131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:51.085132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:51.093290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d075acec-060b-4517-bd4e-39a4471b1a21 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082506 Sep 01 08:48:51.093844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2543/5060] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:51 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:52.113615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:52.114213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:52.116050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:48:52.122027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:52.122530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:52.122956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:52.123621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:52.124063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:52.124477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:52.186108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:52.193523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cb939f61-f08f-465e-b65d-1fc2b3dc41ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083716 Sep 01 08:48:52.194076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2518/5061] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:52 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:53.213692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:53.214236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:53.220052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:53.220523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:53.220949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:53.221633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:53.222057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:53.222501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:53.281041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:53.288628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bc13f225-b975-4be8-a662-64018dd0316f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078806 Sep 01 08:48:53.294550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2544/5062] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:53 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:54.309368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:54.309973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:54.316176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:54.316652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:54.317159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:54.317757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:54.318205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:54.318652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:54.386324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:54.393866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d97ff623-88b7-4ebd-bd0b-8d499864cc39 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.088351 Sep 01 08:48:54.394441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2519/5063] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:54 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:55.415165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:55.415768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:55.421633 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:55.422102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:55.422569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:55.423239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:55.423683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:55.424094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:55.483131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:55.490511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5aa1805a-7eed-4f3f-b828-66e9ca4749c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079723 Sep 01 08:48:55.491071 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2545/5064] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:55 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:56.511981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:56.512591 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:56.518598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:56.519079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:56.519516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:56.520198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:56.520649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:56.521072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:56.582988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:56.591364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-557eae30-4137-40bb-90c2-d54d202bf72e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083853 Sep 01 08:48:56.591918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2520/5065] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:56 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:57.611865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:57.612397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:57.618876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:57.619351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:57.619779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:57.620452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:57.620897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:57.621318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:57.679159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:57.687369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e7c20200-d59c-49c6-917e-18a4bcffb4b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079359 Sep 01 08:48:57.687919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2546/5066] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:57 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:58.707556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:58.708163 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:58.715085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:58.715556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:58.715988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:58.716657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:58.717103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:58.717518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:58.775993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:58.783383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3abe38e0-b1f0-4155-83ef-8bc6b6e34051 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079642 Sep 01 08:48:58.783930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2521/5067] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:58 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:48:59.803256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:48:59.803866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:48:59.810431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:59.811164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:59.811592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:59.812265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:48:59.812710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:48:59.813121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:48:59.872476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:48:59.880065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9c906c37-32a9-4492-8f6b-47a095b8296d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080654 Sep 01 08:48:59.880618 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2547/5068] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:48:59 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:00.901898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:00.902528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:00.908390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:00.908865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:00.909292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:00.909964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:00.910446 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:00.910872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:00.972515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:00.980242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b2a8ecd3-c53e-48e6-8a7a-a7c5abd1a240 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082995 Sep 01 08:49:00.980946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2522/5069] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:00 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:02.001178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:02.001806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:02.007934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:02.008434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:02.008859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:02.009528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:02.009967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:02.010411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:02.069474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:02.077092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5882a5b6-f800-43da-a21d-826f8010c694 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079944 Sep 01 08:49:02.077644 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2548/5070] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:01 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:03.097844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:03.098493 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:03.104904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:03.105375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:03.105800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:03.106502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:03.106946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:03.107364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:03.166349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:03.173682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2a241050-edff-4983-830f-291eb55fe927 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079606 Sep 01 08:49:03.174235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2523/5071] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:03 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:04.196417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:04.196999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:04.202852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:04.203323 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:04.203752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:04.204416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:04.204858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:04.205271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:04.263990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:04.271488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-aba62d17-bacb-48ef-96a4-9d67777dd998 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079301 Sep 01 08:49:04.272030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2549/5072] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:04 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:05.292324 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:05.292900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:05.298988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:05.299458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:05.299880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:05.300581 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:05.301019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:05.301431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:05.362949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:05.370944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dcc33c67-8258-44d6-b6de-a892aeb00f8c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082532 Sep 01 08:49:05.371496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2524/5073] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:05 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:06.392298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:06.392901 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:06.398922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:06.399340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:06.399763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:06.400433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:06.400873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:06.401286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:06.459860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:06.468121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-791d1787-f93a-4b64-ac21-175ec2608639 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079626 Sep 01 08:49:06.468673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2550/5074] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:06 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:07.488847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:07.489450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:07.495976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:07.496447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:07.496875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:07.497540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:07.497981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:07.498426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:07.556884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:07.564477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-61ddff47-0d42-4e5f-82fd-a2560a5dce51 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079414 Sep 01 08:49:07.565035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2525/5075] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:07 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:08.585554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:08.586163 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:08.592342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:08.592821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:08.593251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:08.593921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:08.594392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:08.594814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:08.654066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:08.661425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44999c5a-af76-4340-9f79-90b717fad16d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079681 Sep 01 08:49:08.661973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2551/5076] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:08 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:09.683622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:09.684153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:09.690338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:09.690811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:09.691238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:09.691907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:09.692348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:09.692778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:09.754467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:09.762954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e24ad778-f3c4-4ebf-b912-85ba4430f460 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084068 Sep 01 08:49:09.763505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2526/5077] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:49:10.783253 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:10.783853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:10.789690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:10.790204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:10.790659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:10.791536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:10.791984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:10.792400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:10.851285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:10.858838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e0986620-7bb6-46e1-8e8e-fefd4fc18ffc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079373 Sep 01 08:49:10.859393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2552/5078] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:10 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:11.879066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:11.879678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:11.886450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:11.886933 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:11.887368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:11.888049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:11.888498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:11.888920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:11.947921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:11.955429 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f83f107c-43c0-40e7-bbfd-2ebaff4c9368 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080188 Sep 01 08:49:11.955991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2527/5079] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:11 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:12.976115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:12.976719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:12.983166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:12.983662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:12.984095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:12.984764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:12.985205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:12.985620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:13.043947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:13.051290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6b4ff17a-362a-42ab-b998-8f89cf715f90 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078976 Sep 01 08:49:13.051821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2553/5080] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:12 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:14.073152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:14.073788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:14.079762 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:14.080244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:14.080679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:14.081358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:14.081808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:14.082232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:14.142931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:14.150488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed382a98-c628-4cea-bb87-ebe803f3d5e4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081951 Sep 01 08:49:14.151044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2528/5081] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:14 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:15.170782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:15.171392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:15.177298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:15.177774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:15.178203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:15.178904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:15.179353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:15.179773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:15.238421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:15.245948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ecb48e04-69c0-4d77-b879-d6d80e114195 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078971 Sep 01 08:49:15.246536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2554/5082] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:15 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:16.266629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:16.267242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:16.273289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:16.273767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:16.274835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:16.275523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:16.276408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:16.276832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:16.280774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:16.336297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:16.344337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-905a08ef-65a1-43c0-af9e-d2e2318b0bc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081599 Sep 01 08:49:16.344887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2529/5083] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:16 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:17.364746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:17.365355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:17.367319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:49:17.367463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:49:17.374027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:17.374539 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:17.374968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:17.375641 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:17.376087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:17.376542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:17.436104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:17.443831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-34a5e786-d0ea-4ecd-9e5b-fbae3ce828ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082823 Sep 01 08:49:17.444392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2555/5084] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:17 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:18.464024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:18.464633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:18.470655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:18.471138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:18.471726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:18.472248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:18.472697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:18.473126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:18.535095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:18.542853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e785ecc-5adc-40fa-b158-681cebcf32fa tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082820 Sep 01 08:49:18.543408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2530/5085] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:18 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:19.563821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:19.564656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:19.570523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:19.571535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:19.572070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:19.572802 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:19.573249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:19.573667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:19.634849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:19.642363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fcbe71cb-445d-486d-8061-c7e25ab6960c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082561 Sep 01 08:49:19.642917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2556/5086] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:19 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:20.666353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:20.666955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:20.673661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:20.674141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:20.674612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:20.675293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:20.675755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:20.676156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:20.735528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:20.743046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-670ea19c-e98b-47be-8ee6-170a2b539be2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080494 Sep 01 08:49:20.743611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2531/5087] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:20 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:21.763271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:21.763813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:21.765664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:21.770817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:21.771297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:21.771728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:21.772403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:21.772853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:21.773272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:21.777883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:21.832650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:21.840789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-72095fb6-1e36-4955-bea9-061be600d281 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081385 Sep 01 08:49:21.841343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2557/5088] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:21 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:22.860760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:22.861366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:22.863221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:22.868274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:22.868748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:22.869178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:22.869850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:22.870321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:22.870743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:22.934963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:22.942674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4e47d588-ecb8-41af-af0c-ad8b364fd2d6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085676 Sep 01 08:49:22.943225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2532/5089] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:22 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:23.964182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:23.964903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:23.970903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:23.971374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:23.971799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:23.972466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:23.972904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:23.973317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:24.035335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:24.043845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-394db09c-c00f-4d7d-a2b3-2a1ef2a56053 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084198 Sep 01 08:49:24.044411 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2558/5090] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:23 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:25.065217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:25.065821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:25.072151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:25.072629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:25.073061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:25.073764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:25.074210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:25.074653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:25.134127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:25.141523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c0bc8fda-d991-4293-b6db-4b1aca387360 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080152 Sep 01 08:49:25.142071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2533/5091] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:25 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:26.162414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:26.162945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:26.170044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:26.170550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:26.170984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:26.171662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:26.172106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:26.172520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:26.233468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:26.241034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-91147911-7f05-4b11-860b-89e20d285aa8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082556 Sep 01 08:49:26.241590 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2559/5092] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:26 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:27.262181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:27.262833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:27.268774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:27.269254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:27.269687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:27.270394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:27.270846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:27.271270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:27.333494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:27.341710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b00ebaa5-e291-4cf2-931f-bca465797616 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083840 Sep 01 08:49:27.342282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2534/5093] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:27 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:28.362515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:28.363159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:28.369223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:28.369700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:28.370130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:28.370842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:28.371292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:28.371711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:28.430418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:28.438450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-df6f90ab-e41c-403c-abde-847c90488482 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079646 Sep 01 08:49:28.439036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2560/5094] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:28 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:29.459016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:29.459618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:29.465480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:29.465955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:29.466413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:29.467083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:29.467525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:29.467939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:29.526623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:29.533982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e17818b5-cd8b-4d32-8d7d-88dffcb5b278 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078769 Sep 01 08:49:29.534562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2535/5095] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:29 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:30.554683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:30.555290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:30.561456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:30.561930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:30.562386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:30.563062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:30.563510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:30.563928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:30.622598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:30.630089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f10fce13-2b3c-41e1-8de2-9e16c1e59e7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079224 Sep 01 08:49:30.630677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2561/5096] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:30 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:31.651190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:31.652368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:31.660048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:31.660529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:31.660960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:31.661660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:31.662107 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:31.662549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:31.727421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:31.734962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cd238ddb-ba6e-4198-92a8-5f3dbfe36f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.088566 Sep 01 08:49:31.735519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2536/5097] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:31 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:32.755199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:32.755733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:32.761682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:32.762147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:32.762615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:32.763277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:32.763719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:32.764131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:32.822639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:32.830116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2fcb87c5-152b-4d97-87c7-b9152af59fc7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078822 Sep 01 08:49:32.830702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2562/5098] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:32 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:33.851193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:33.852308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:33.858405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:33.858876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:33.859302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:33.859971 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:33.860412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:33.860827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:33.920061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:33.927457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-21484c48-d018-4f5b-8ee2-08cd54915b7f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080103 Sep 01 08:49:33.928005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2537/5099] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:33 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:34.949386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:34.949983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:34.956078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:34.956551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:34.956979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:34.957649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:34.958093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:34.958535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:35.017211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:35.025643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-44f318ee-41ba-4321-8a89-0a77b2372386 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080155 Sep 01 08:49:35.026194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2563/5100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:34 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:36.045400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:36.046009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:36.052055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:36.052540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:36.052975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:36.053654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:36.054103 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:36.054561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:36.116606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:36.124347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7a2e3462-e0b8-4c04-85fc-5f6fa93cbdf2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082719 Sep 01 08:49:36.124911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2538/5101] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:36 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:37.145382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:37.146015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:37.152431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:37.152906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:37.153338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:37.154012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:37.154486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:37.154908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:37.214154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:37.221615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2a3bac8a-1e41-421c-95f7-7a0a2f15a91d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080144 Sep 01 08:49:37.222168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2564/5102] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:37 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:38.242922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:38.243604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:38.249459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:38.249936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:38.250410 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:38.251088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:38.251536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:38.251953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:38.315258 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:38.322794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b9e3f588-8080-4c07-9810-51baae0a3483 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084227 Sep 01 08:49:38.323350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2539/5103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:38 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:39.343198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:39.343801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:39.349681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:39.350157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:39.350611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:39.351282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:39.352236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:39.352651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:39.410402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:39.418429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7eb31755-8f42-4ddc-9cd0-3c501a3217c8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078992 Sep 01 08:49:39.418976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2565/5104] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:39 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:49:40.438825 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:40.439528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:40.446157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:40.446664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:40.447088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:40.447772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:40.448213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:40.448630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:40.510091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:40.517629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5ebdea6f-41dd-4d96-8317-96b57cc2ba26 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082832 Sep 01 08:49:40.518192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2540/5105] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:40 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:41.536889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:41.537502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:41.543679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:41.544158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:41.544591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:41.545269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:41.545719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:41.546138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:41.605606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:41.613029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-263e4ef3-ebfd-439e-9d00-24b75c358101 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079928 Sep 01 08:49:41.613586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2566/5106] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:41 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:42.633477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:42.634087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:42.640124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:42.640601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:42.641036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:42.641717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:42.642169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:42.642624 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:42.701813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:42.709244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0af44702-7d10-4535-8496-512dea806dbe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079767 Sep 01 08:49:42.709801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2541/5107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:42 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:43.730041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:43.730619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:43.736578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:43.737054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:43.737485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:43.738159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:43.738640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:43.739067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:43.801255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:43.808908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ce546f2-7ac1-445b-85c9-890bec6223f3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082710 Sep 01 08:49:43.809466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2567/5108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:43 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:44.830470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:44.831113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:44.833060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:49:44.833203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:49:44.834197 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:49:44.834344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:49:44.841252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:44.841737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:44.842171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:44.842884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:44.843340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:44.843763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:44.910062 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:44.917676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-32ef068e-f07d-4c75-af21-d491c16780c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.091114 Sep 01 08:49:44.918230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2542/5109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:44 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:45.938537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:45.939146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:45.941109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:49:45.941250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:49:45.952953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:45.953446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:45.953850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:45.954551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:45.954997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:45.955410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:46.014910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:46.022324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-55b3cb0c-317c-43eb-a036-5457042a6fe5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.087899 Sep 01 08:49:46.022879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2568/5110] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:45 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:47.043117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:47.043723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:47.049647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:47.050123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:47.050596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:47.051312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:47.051763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:47.052185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:47.056592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:47.112839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:47.120833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-60bd6649-fa12-405c-baf5-5e80b9f963b1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081602 Sep 01 08:49:47.121394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2543/5111] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:47 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:48.141473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:48.142077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:48.148277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:48.149261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:48.149688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:48.150389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:48.150833 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:48.151247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:48.209205 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:48.217165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-97891e8f-6158-4a2f-a209-6efe1b60752a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079468 Sep 01 08:49:48.217715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2569/5112] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:48 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:49.237318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:49.237952 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:49.243925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:49.244405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:49.244833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:49.245510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:49.245957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:49.246401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:49.307718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:49.315482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f3212ead-d886-4c60-91aa-f5de007d50e0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082034 Sep 01 08:49:49.316564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2544/5113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:49 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:50.337179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:50.337792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:50.343955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:50.344435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:50.344875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:50.345558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:50.346008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:50.346460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:50.409997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:50.417822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b9e3cb79-9cba-4cf3-a327-9287e69a2f93 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085772 Sep 01 08:49:50.418399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2570/5114] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:50 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:51.438278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:51.438887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:51.444899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:51.445371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:51.445808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:51.447152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:51.447599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:51.448017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:51.506694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:51.514770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-138e92b5-e6c0-4c45-a27d-5b9f3e16b992 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080685 Sep 01 08:49:51.515328 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2545/5115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:51 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:52.535171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:52.535777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:52.537572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:52.542954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:52.543415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:52.543840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:52.544508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:52.544950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:52.545365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:52.548005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:52.605074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:52.612461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2246345a-d0fb-4c03-b6dc-870278f422cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081107 Sep 01 08:49:52.613022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2571/5116] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:52 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:53.632826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:53.633567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:53.636364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:49:53.641690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:53.642169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:53.642633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:53.643386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:53.643840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:53.644263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:53.712302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:53.719799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8756d1ff-90b3-4380-863d-c3037a826029 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.090855 Sep 01 08:49:53.720357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2546/5117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:53 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:54.740043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:54.740619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:54.747492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:54.747968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:54.748395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:54.749068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:54.749511 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:54.749925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:54.808651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:54.816311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18c7b224-51ea-42ab-8ace-c83c8a25459c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080189 Sep 01 08:49:54.816869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2572/5118] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:54 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:55.836692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:55.837310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:55.843247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:55.843718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:55.844142 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:55.844812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:55.845256 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:55.845672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:55.905139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:55.913136 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dd68e463-1140-4b7b-813e-2fe1210e87bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080204 Sep 01 08:49:55.913849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2547/5119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:55 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:56.934983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:56.935586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:56.941495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:56.941965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:56.942425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:56.943096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:56.943558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:56.943974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:57.007198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:57.015380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4fdfb64c-7a3e-4926-a364-752cdbf9e6b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084708 Sep 01 08:49:57.015930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2573/5120] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:56 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:58.036045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:58.036646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:58.043070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:58.043549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:58.043973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:58.044644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:58.045083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:58.045501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:58.106765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:58.114283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bb9b4d3b-5835-48de-9aa1-c187b6079465 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082013 Sep 01 08:49:58.114867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2548/5121] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:58 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:49:59.135727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:49:59.136326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:49:59.142187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:59.142679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:59.143105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:59.143772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:49:59.144218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:49:59.144643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:49:59.203551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:49:59.210966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1d8bcb9-5036-4d94-9c1c-58a53277e2a1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079948 Sep 01 08:49:59.211517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2574/5122] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:49:59 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:00.232166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:00.232839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:00.238650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:00.239127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:00.239554 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:00.240228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:00.240678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:00.241095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:00.299915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:00.308104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b5a99225-2c97-40b1-8548-dd29021ca4b8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079935 Sep 01 08:50:00.308665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2549/5123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:00 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:01.328736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:01.329346 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:01.335293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:01.335772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:01.336203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:01.337585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:01.338039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:01.338487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:01.397117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:01.405209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a767afbc-5b59-4a70-8aea-e11e127bd4fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080278 Sep 01 08:50:01.405772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2575/5124] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:01 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:02.426036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:02.426664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:02.432612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:02.433091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:02.433521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:02.434193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:02.434934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:02.435349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:02.499737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:02.507300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-374ee377-666a-4743-94b8-5338cfb028da tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085104 Sep 01 08:50:02.507860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2550/5125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:02 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:03.528836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:03.529461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:03.535358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:03.535826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:03.536251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:03.536916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:03.537358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:03.537768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:03.597739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:03.605891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23d2e0c0-d87c-4077-b7a1-9d480070016b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081158 Sep 01 08:50:03.606472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2576/5126] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:03 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:04.626356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:04.626968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:04.633033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:04.634010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:04.634608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:04.635347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:04.635809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:04.636366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:04.694678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:04.702736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-77b86d23-f841-4944-b7a2-b13045d62e3b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080203 Sep 01 08:50:04.703301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2551/5127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:04 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:05.723881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:05.724427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:05.730587 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:05.731068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:05.731505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:05.732181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:05.732632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:05.733058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:05.791615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:05.799084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ee251dc-c62c-4dcd-84cd-ef3f32b56335 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079162 Sep 01 08:50:05.799656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2577/5128] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:05 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:06.820800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:06.821580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:06.827635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:06.828109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:06.828537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:06.829213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:06.829654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:06.830070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:06.891574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:06.899017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f831829b-8daf-4c76-b0e1-1474770ba715 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082317 Sep 01 08:50:06.899569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2552/5129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:06 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:07.920333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:07.920942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:07.926919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:07.927384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:07.927804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:07.928470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:07.928910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:07.929322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:07.988458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:07.996236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02b9187a-c272-4114-b6f6-5432d8c231e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080216 Sep 01 08:50:07.996797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2578/5130] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:07 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:50:09.016604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:09.017213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:09.023114 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:09.024262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:09.024797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:09.025479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:09.025935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:09.026385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:09.085508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:09.093881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ca161bfc-ca42-4146-81f5-0190f3924df9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081192 Sep 01 08:50:09.094480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2553/5131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:10.114300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:10.114826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:10.121444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:10.121908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:10.122365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:10.123033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:10.123476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:10.123887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:10.182812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:10.190365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8ceba9b8-ca9a-471b-a3bb-769cf76624ec tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079945 Sep 01 08:50:10.190916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2579/5132] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:10 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:11.210531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:11.211649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:11.217562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:11.218039 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:11.218503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:11.219181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:11.219629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:11.220046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:11.281996 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:11.289490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8cd1d66d-cab4-4eb4-a617-cb7210f8bd9f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082843 Sep 01 08:50:11.290033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2554/5133] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:11 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:12.310252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:12.310871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:12.316759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:12.317228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:12.317654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:12.318344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:12.318789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:12.319207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:12.377931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:12.386044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-49c68978-bed1-4946-a596-fb25f8ccf176 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079811 Sep 01 08:50:12.386621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2580/5134] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:12 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:13.406345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:13.406948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:13.412958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:13.413426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:13.413852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:13.415287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:13.415732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:13.416147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:13.474957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:13.483102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-62ea5935-9bc1-473e-a23e-bf9f0f0d509e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080539 Sep 01 08:50:13.483650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2555/5135] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:13 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:14.503355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:14.503956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:14.510119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:14.510621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:14.511047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:14.511713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:14.512156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:14.512569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:14.570852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:14.578191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c83134ce-f031-45d7-9b36-9f04507c84bf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078712 Sep 01 08:50:14.578768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2581/5136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:14 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:15.598775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:15.599311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:15.605915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:15.606428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:15.606863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:15.607539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:15.608023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:15.608443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:15.669765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:15.677235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ccc255a1-b74c-4d9c-b808-39d29746a64d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082338 Sep 01 08:50:15.677785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2556/5137] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:15 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:16.698199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:16.698916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:16.704793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:16.705269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:16.705698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:16.706418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:16.706870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:16.707290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:16.772138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:16.781185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f9c000a-50db-4078-9293-f6568063e6a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.087195 Sep 01 08:50:16.781772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2582/5138] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:16 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:17.802518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:17.803126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:17.809386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:17.809863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:17.810313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:17.810988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:17.811433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:17.811873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:17.815699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:17.871074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:17.878534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5c1f7fc7-97d7-4ea2-b7b2-c585f79d58ce tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079832 Sep 01 08:50:17.879090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2557/5139] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:17 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:18.898141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:18.899412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:18.905320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:18.905794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:18.906227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:18.906921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:18.907365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:18.907783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:18.974553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:18.982175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a85bb72a-14fb-4b38-8359-fa849c89db8a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.087873 Sep 01 08:50:18.982763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2583/5140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:18 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:20.001793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:20.002408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:20.008899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:20.009373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:20.009799 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:20.010502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:20.010947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:20.012411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:20.074187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:20.081686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f8da43f3-2feb-4401-8518-bfb38e2b41e2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083734 Sep 01 08:50:20.082242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2558/5141] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:19 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:50:21.102183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:21.102815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:21.108627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:21.109099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:21.109524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:21.110193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:21.110662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:21.111079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:21.171758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:21.179230 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-75ebed30-f88c-46a5-849e-049220e1e16e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080916 Sep 01 08:50:21.179823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2584/5142] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:21 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:22.199697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:22.200308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:22.206216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:22.206723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:22.207168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:22.207844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:22.208294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:22.208719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:22.267896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:22.276038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-881d605e-b6db-4c58-8f8f-00686d29a396 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080171 Sep 01 08:50:22.276622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2559/5143] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:22 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:23.296736 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:23.297340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:23.299174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:23.304308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:23.305530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:23.305996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:23.306738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:23.307202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:23.307626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:23.310969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:23.368946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:23.376384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a42f3c5e-81e0-4ce5-829e-35f8fd87f6ef tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083452 Sep 01 08:50:23.376936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2585/5144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:23 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:24.396817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:24.397415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:24.399796 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:24.405146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:24.405632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:24.406068 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:24.406806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:24.407263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:24.407688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:24.471934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:24.480179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-168009d6-feac-47f0-b835-a7a5ca40620b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.087141 Sep 01 08:50:24.480737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2560/5145] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:24 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:25.499500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:25.500113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:25.506078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:25.506591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:25.507024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:25.508198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:25.508652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:25.509073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:25.569012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:25.577181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-273f617c-cb79-4abb-838e-546d191da9f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081472 Sep 01 08:50:25.577740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2586/5146] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:25 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:26.598164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:26.598721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:26.605277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:26.605748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:26.606174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:26.606862 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:26.607302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:26.607714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:26.666400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:26.673812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4f30a54d-5d14-410e-8adb-eeaf09ce7ecc tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079552 Sep 01 08:50:26.674382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2561/5147] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:26 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:27.694519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:27.695735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:27.701573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:27.702038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:27.702497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:27.703162 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:27.703603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:27.704015 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:27.762944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:27.770343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-02e0780a-43e0-47e0-9f71-e136a96d8147 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079707 Sep 01 08:50:27.770895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2587/5148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:27 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:28.791173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:28.791779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:28.797697 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:28.798174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:28.798636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:28.799311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:28.799758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:28.800177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:28.862772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:28.870903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-14180632-3f41-4580-9e09-c682eb90233c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083913 Sep 01 08:50:28.871465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2562/5149] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:28 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:29.891883 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:29.892482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:29.898865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:29.899338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:29.899773 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:29.900438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:29.900878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:29.901294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:29.959650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:29.967691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ffc3616a-2231-4d0c-929d-d9a25bb3a296 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079758 Sep 01 08:50:29.968237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2588/5150] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:29 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:30.988635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:30.989243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:30.995452 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:30.995992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:30.996451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:30.997133 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:30.997579 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:30.997997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:31.060699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:31.068233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9a1a52d7-fac3-4af4-8c3e-9b6b4d056a66 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083437 Sep 01 08:50:31.068785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2563/5151] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:30 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:32.089191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:32.089786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:32.095682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:32.096135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:32.096564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:32.097231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:32.097674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:32.098087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:32.156508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:32.163963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a665dd84-ad61-4aec-bbf4-baa9aab6ed92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078559 Sep 01 08:50:32.164518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2589/5152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:32 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:33.183815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:33.184412 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:33.190353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:33.190836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:33.191270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:33.191945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:33.192395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:33.192818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:33.253390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:33.261438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-638b3a32-38f1-4f63-bc8c-c15ca826d953 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081734 Sep 01 08:50:33.261995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2564/5153] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:33 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:34.282927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:34.283530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:34.290217 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:34.290714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:34.291141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:34.291812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:34.292251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:34.292665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:34.355286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:34.362754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-24b06d81-8ad6-46c8-a4ce-339746c86737 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083651 Sep 01 08:50:34.363314 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2590/5154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:34 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:35.383763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:35.384370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:35.390216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:35.390724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:35.391154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:35.391827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:35.392272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:35.392696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:35.452402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:35.459975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cc4353e0-cf7d-4906-809a-8251085d60f0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080749 Sep 01 08:50:35.461220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2565/5155] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:35 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:36.480373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:36.481010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:36.486939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:36.487415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:36.487904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:36.488578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:36.489025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:36.489445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:36.547786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:36.556052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dbfe76af-a87e-49fb-9cf4-9020459fa6ed tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079557 Sep 01 08:50:36.556604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2591/5156] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:36 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:37.577072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:37.577708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:37.583704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:37.584187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:37.584616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:37.585357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:37.585949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:37.586505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:37.647693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:37.655342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f873c0c0-e371-45c4-a9fc-bbd31653eb34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082147 Sep 01 08:50:37.655891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2566/5157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:37 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:38.675019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:38.675627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:38.681756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:38.682235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:38.682695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:38.683370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:38.684084 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:38.684529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:38.743243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:38.750763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd5569ba-27b1-4968-9ddd-5b7fb3429f42 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079585 Sep 01 08:50:38.751322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2592/5158] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:38 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:39.771542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:39.772075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:39.779285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:39.779801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:39.780269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:39.780958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:39.781404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:39.781808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:39.845468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:39.853942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2b941ad9-21ef-4b84-b12c-9e33b932910c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.086288 Sep 01 08:50:39.854630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2567/5159] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:39 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:40.874703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:40.875322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:40.881227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:40.881707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:40.882142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:40.883142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:40.883596 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:40.884021 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:40.946933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:40.954867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b849566b-77d9-4fdd-840d-001f2c5892cd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083996 Sep 01 08:50:40.955472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2593/5160] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:40 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:41.975443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:41.976235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:41.981947 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:41.982481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:41.982919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:41.983592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:41.984041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:41.984463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:42.045628 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:42.053128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2aea4777-5b43-42f4-a93c-da889f38c2f7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081494 Sep 01 08:50:42.053676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2568/5161] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:41 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:43.073705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:43.074334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:43.080341 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:43.080811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:43.081236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:43.081911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:43.082454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:43.082876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:43.147658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:43.155139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41995d9f-a483-4e4f-9a07-2610bc54d872 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085384 Sep 01 08:50:43.155692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2594/5162] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:43 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:44.175648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:44.176251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:44.182898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:44.183665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:44.184098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:44.184781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:44.185232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:44.185647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:44.245058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:44.252514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d2dd6b35-3b9a-4bcf-b694-08fc96620985 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080602 Sep 01 08:50:44.253117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2569/5163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:44 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:45.274522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:45.275044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:45.280978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:45.281456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:45.281887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:45.282592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:45.283041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:45.283456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:45.343470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:45.351877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-53f7616e-8b6e-436b-b14b-fb91e10f7afe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081339 Sep 01 08:50:45.352435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2595/5164] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:45 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:46.372243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:46.372877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:46.378758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:46.379244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:46.379682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:46.380355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:46.380804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:46.381226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:46.443314 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:46.451791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7e1068b0-b96f-427b-b32e-1e92eb4f02e9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083365 Sep 01 08:50:46.452353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2570/5165] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:46 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:47.472303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:47.472913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:47.478961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:47.479431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:47.479854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:47.480519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:47.480961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:47.481370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:47.540607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:47.548099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-453399e2-7e37-424b-8566-e9ebd8d263d4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079683 Sep 01 08:50:47.548650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2596/5166] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:47 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:48.569212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:48.570351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:48.576307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:48.576779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:48.577201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:48.577871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:48.578336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:48.578751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:48.581199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:48.639172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:48.646556 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1204c955-4e2b-4072-bf42-7a8638646527 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081222 Sep 01 08:50:48.647104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2571/5167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:48 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:49.666758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:49.667291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:49.673143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:49.673617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:49.674045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:49.674735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:49.675180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:49.675589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:49.734797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:49.743070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e974d066-ac78-4134-a3dc-dfa42398018b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080209 Sep 01 08:50:49.743621 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2597/5168] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:49 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:50.764101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:50.764621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:50.770567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:50.771042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:50.771477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:50.772157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:50.773430 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:50.773850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:50.834311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:50.842782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3ed0bea-319c-46c6-98a1-92f3c8143026 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082697 Sep 01 08:50:50.843343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2572/5169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:50 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:51.862924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:51.863533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:51.870069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:51.870568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:51.870996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:51.871671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:51.872120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:51.872536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:51.932789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:51.940498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6c932d3b-bd99-4b78-a2ea-c6030040d95a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081467 Sep 01 08:50:51.941055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2598/5170] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:51 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:52.962568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:52.963174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:52.969058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:52.969534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:52.969965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:52.970662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:52.971110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:52.971531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:53.074705 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:53.082173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24928507-4dc2-4f3c-90d8-17d24f133df1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.124261 Sep 01 08:50:53.082756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2573/5171] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:52 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:54.103335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:54.103961 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:54.105764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:54.111069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:54.111545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:54.111973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:54.112682 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:54.113131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:54.113551 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:54.117594 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:54.216296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:54.223749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-15db31f0-4e2e-4a96-84be-0b167034e8c6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.124915 Sep 01 08:50:54.224303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2599/5172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:54 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:55.243612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:55.244250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:55.246063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:55.251396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:55.251877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:55.252337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:55.253071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:55.253519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:55.253938 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:55.315709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:55.323793 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-db373046-17a6-402e-a547-8d4bef98a9ba tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084249 Sep 01 08:50:55.324350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2574/5173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:55 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:56.346506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:56.347118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:56.353648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:56.354124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:56.354575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:56.355246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:56.355687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:56.356098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:56.415939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:56.424579 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d9357322-6e72-4684-97de-7f50d3183d67 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081873 Sep 01 08:50:56.425143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2600/5174] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:56 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:57.449086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:57.449620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:57.455473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:57.455944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:57.456367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:57.457030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:57.457471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:57.457882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:57.516738 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:57.524155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2da6042f-06ed-4a4d-ae82-9cd371832c37 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078934 Sep 01 08:50:57.524702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2575/5175] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:57 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:58.544434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:58.545033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:58.551157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:58.551626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:58.552060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:58.552714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:58.553158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:58.554153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:58.613032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:58.621041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-978ce7eb-52ce-4a6a-b7b9-cc5efd0e4344 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080418 Sep 01 08:50:58.621588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2601/5176] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:58 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:50:59.641448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:50:59.642021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:50:59.648126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:59.648599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:59.649030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:59.649704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:50:59.650154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:50:59.650601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:50:59.711641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:50:59.719135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3a13dc0-599b-4de0-b786-419a60bc1387 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081569 Sep 01 08:50:59.719695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2576/5177] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:50:59 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:00.739451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:00.739983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:00.746515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:00.746997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:00.747432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:00.748112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:00.748563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:00.748988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:00.807396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:00.815156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ce03b5ca-18fb-4583-9e4e-d29363eddf04 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079603 Sep 01 08:51:00.815713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2602/5178] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:00 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:01.836210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:01.836819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:01.842820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:01.843300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:01.843730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:01.844437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:01.844886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:01.845307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:01.904156 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:01.911608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-665580a0-6dcf-4dc4-8104-756d327a8941 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079260 Sep 01 08:51:01.912171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2577/5179] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:01 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:02.933129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:02.933733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:02.939652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:02.940126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:02.940552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:02.941225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:02.941663 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:02.942088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:03.001306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:03.009497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5bf330f-fa61-4769-a645-705ea702f232 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080950 Sep 01 08:51:03.010046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2603/5180] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:02 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:04.029640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:04.030251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:04.036532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:04.037012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:04.037449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:04.038202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:04.038699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:04.039129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:04.103553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:04.111020 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9ba5f60b-3a84-4b46-9767-d01fce649c46 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085225 Sep 01 08:51:04.111574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2578/5181] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:04 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:05.255725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:05.256326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:05.262946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:05.263416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:05.263840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:05.264515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:05.264958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:05.265372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:05.324380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:05.331846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd888fe3-a92e-4f91-8057-52ad7f5cad25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.204175 Sep 01 08:51:05.332400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2604/5182] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:05 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:06.352689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:06.353285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:06.359170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:06.359645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:06.360070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:06.360742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:06.361207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:06.361601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:06.423773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:06.431689 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-af1671ae-928c-4547-ac1e-10a3350abbf9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083403 Sep 01 08:51:06.432240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2579/5183] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:06 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:07.452984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:07.453519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:07.459351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:07.459828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:07.460347 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:07.461017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:07.461461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:07.461879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:07.521013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:07.528844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8d293840-4bbb-44c7-8c50-40869c1bd126 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079770 Sep 01 08:51:07.529410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2605/5184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:07 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:08.548876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:08.549478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:08.555595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:08.556065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:08.556489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:08.557154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:08.557595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:08.558301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:08.620319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:08.627782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c2eb3ab6-58d2-4ed6-8db8-74c16f03467f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082725 Sep 01 08:51:08.628329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2580/5185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:08 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:09.648240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:09.648771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:09.654640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:09.655119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:09.655542 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:09.656211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:09.656654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:09.657066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:09.715881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:09.723442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d6981a6-6f3f-42be-b8e1-c7b14f950875 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079100 Sep 01 08:51:09.723999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2606/5186] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:10.744688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:10.745210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:10.751220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:10.751690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:10.752118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:10.752789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:10.753235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:10.753653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:10.812318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:10.820542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3a0e32f7-9e03-4e18-827c-bc667bc2dff3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079864 Sep 01 08:51:10.821123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2581/5187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:10 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:11.841359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:11.841962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:11.847856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:11.848328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:11.848754 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:11.849421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:11.849864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:11.850388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:11.908207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:11.915566 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-efbd9443-bf50-4765-b326-304c1b5d40e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.077992 Sep 01 08:51:11.916119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2607/5188] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:11 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:12.936005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:12.936618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:12.942526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:12.943006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:12.943438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:12.944120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:12.944788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:12.945216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:13.005987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:13.014135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f416f874-b8b4-480a-aab3-76f3184fe617 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082251 Sep 01 08:51:13.014722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2582/5189] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:12 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:14.035125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:14.035724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:14.042276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:14.042758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:14.043189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:14.043861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:14.044308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:14.044727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:14.105245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:14.112785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d934e753-1b67-4dbe-ac1f-737acfb3d612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081516 Sep 01 08:51:14.113337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2608/5190] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:14 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:15.133841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:15.134485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:15.140390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:15.140872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:15.141304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:15.141980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:15.142464 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:15.142883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:15.202201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:15.210162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3f732f9-f7da-4ed0-b38b-8285a52397cf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079748 Sep 01 08:51:15.210835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2583/5191] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:15 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:16.230908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:16.231512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:16.237356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:16.237832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:16.238276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:16.238958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:16.239404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:16.239822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:16.298572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:16.306852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c43221e4-a64c-4ff5-a317-fc3d2c793130 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079744 Sep 01 08:51:16.307408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2609/5192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:16 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:17.327286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:17.327896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:17.333783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:17.334278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:17.334864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:17.335515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:17.335959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:17.336380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:17.398124 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:17.405642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed02f795-e3f3-4a12-bea4-74fa260fbbb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082200 Sep 01 08:51:17.406200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2584/5193] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:17 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:18.426304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:18.426911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:18.433225 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:18.433709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:18.434144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:18.434888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:18.435343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:18.435765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:18.496261 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:18.503749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd0cb208-2c0e-42a5-870b-f27dd5f4dd5a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081342 Sep 01 08:51:18.504303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2610/5194] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:18 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:19.523981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:19.524577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:19.530501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:19.530975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:19.531403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:19.532069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:19.532514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:19.532927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:19.535404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:19.592652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:19.600028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-26c96da1-802f-4126-9192-01e40b1a2e8f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080151 Sep 01 08:51:19.600722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2585/5195] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:19 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:20.620935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:20.621540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:20.627363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:20.627837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:20.628268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:20.628946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:20.629393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:20.629812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:20.689507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:20.697407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23b4699d-a650-49f8-96ec-95c668b58114 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080213 Sep 01 08:51:20.697957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2611/5196] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:20 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:21.716923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:21.717466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:21.723461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:21.723913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:21.724502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:21.725191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:21.725656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:21.726143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:21.788336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:21.796396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-90c201c0-3fed-4190-b43a-3158455f10e6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083327 Sep 01 08:51:21.796953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2586/5197] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:21 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:22.817603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:22.818203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:22.824835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:22.825306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:22.825730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:22.826431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:22.826875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:22.827290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:22.887948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:22.895452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4c5242fb-2250-4567-9d2b-24af60562930 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081668 Sep 01 08:51:22.896017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2612/5198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:22 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:23.916868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:23.917472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:23.923596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:23.924072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:23.924502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:23.925175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:23.925616 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:23.926047 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:23.984784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:23.992349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e58c568d-2a14-4636-80db-3504b4750845 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079998 Sep 01 08:51:23.992967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2587/5199] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:23 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:25.012795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:25.013400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:25.015342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:25.020554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:25.021034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:25.021468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:25.022191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:25.022740 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:25.023161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:25.025824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:25.082824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:25.090393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8e1bcd5d-9154-479c-a252-c9981a41cb55 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081452 Sep 01 08:51:25.090953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2613/5200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:25 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:26.111306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:26.111911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:26.114284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:26.120404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:26.120876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:26.121301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:26.121978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:26.122567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:26.122988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:26.185178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:26.192692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-98c65290-ef70-4edd-8ce0-f7dee27d8883 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085359 Sep 01 08:51:26.193255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2588/5201] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:26 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:27.214045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:27.214656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:27.220800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:27.221282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:27.221705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:27.222418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:27.222863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:27.223277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:27.282300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:27.289764 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38497c90-5e6f-4528-b336-223b555c5e11 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080165 Sep 01 08:51:27.290333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2614/5202] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:27 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:28.310524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:28.311131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:28.316945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:28.317416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:28.317841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:28.318647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:28.319235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:28.319673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:28.378607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:28.386176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19c0c208-dc54-4524-a2c6-f73a59a49486 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079723 Sep 01 08:51:28.386767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2589/5203] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:28 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:29.407672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:29.408335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:29.414211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:29.414717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:29.415148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:29.415822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:29.416267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:29.416684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:29.475677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:29.484066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e874689a-4ee8-47ba-b5a0-cedf3dcb5780 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080181 Sep 01 08:51:29.484627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2615/5204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:29 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:30.505029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:30.505640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:30.512362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:30.512874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:30.513304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:30.513977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:30.514456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:30.514908 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:30.576707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:30.584211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-42e16395-d020-46a1-8d34-9ee8aed6fb45 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082973 Sep 01 08:51:30.584765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2590/5205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:30 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:31.605477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:31.606078 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:31.611939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:31.612404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:31.612823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:31.613485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:31.613924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:31.614358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:31.672522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:31.680044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6986a686-d471-4bf2-874e-0aebda684b34 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079019 Sep 01 08:51:31.680597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2616/5206] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:31 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:32.700805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:32.701409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:32.707455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:32.707926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:32.708352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:32.709019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:32.709466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:32.709877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:32.768820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:32.776192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a51d29e9-47a1-4d3a-831d-bca1e343ef1c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079233 Sep 01 08:51:32.776735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2591/5207] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:32 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:33.796175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:33.796811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:33.802792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:33.803269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:33.803700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:33.804884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:33.805356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:33.805774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:33.863862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:33.871913 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ec89786c-e7b1-43f3-b434-79f23cf4885a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079561 Sep 01 08:51:33.872470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2617/5208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:33 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:34.892953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:34.893652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:34.900161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:34.900639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:34.901060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:34.901728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:34.902184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:34.902607 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:34.964580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:34.972193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3fb3b7e-5409-4d55-967f-8148a47f017b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083068 Sep 01 08:51:34.972758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2592/5209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:34 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:35.992674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:35.993389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:35.999293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:35.999762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:36.000185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:36.000855 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:36.001292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:36.001703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:36.062547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:36.071031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41c0f232-ce66-44ad-88d2-421265fdbd36 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082220 Sep 01 08:51:36.071588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2618/5210] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:35 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:37.090725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:37.091333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:37.097200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:37.097671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:37.098095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:37.098797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:37.099238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:37.099652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:37.159129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:37.167064 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5dc07bc3-8dd1-49b3-8a41-cc4eac97c612 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080127 Sep 01 08:51:37.167622 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2593/5211] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:37 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:38.188716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:38.189319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:38.195190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:38.195659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:38.196089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:38.196756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:38.197202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:38.197619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:38.256122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:38.263753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2b9616d2-6439-4f34-8148-b8d384e820c7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078860 Sep 01 08:51:38.264303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2619/5212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:38 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:39.284726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:39.285329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:39.291752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:39.292221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:39.292644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:39.293309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:39.293750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:39.294167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:39.355926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:39.363359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3e1aa80a-84c2-4f97-86b9-9a82ce52f948 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082457 Sep 01 08:51:39.363904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2594/5213] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:39 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:40.384880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:40.385474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:40.391316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:40.391793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:40.392239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:40.392910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:40.393351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:40.393767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:40.452762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:40.460157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2cfa032f-901d-4c64-9331-3eaae6b42fcb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079226 Sep 01 08:51:40.461291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2620/5214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:40 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:41.480921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:41.481468 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:41.487340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:41.487812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:41.488236 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:41.488906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:41.489348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:41.489763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:41.549010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:41.558018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-995481ae-fa8d-4b02-9a66-6aaf88082934 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080937 Sep 01 08:51:41.558610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2595/5215] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:41 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:42.578151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:42.578789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:42.584653 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:42.585128 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:42.586355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:42.587151 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:42.587602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:42.588023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:42.655257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:42.662661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f6e2f261-331c-405b-b93c-d9cfae0b2283 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.088259 Sep 01 08:51:42.663214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2621/5216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:42 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:43.684239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:43.684771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:43.690845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:43.691318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:43.691750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:43.692420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:43.692863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:43.693279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:43.893611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:43.902116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-28e04142-27df-45ce-a8f8-4c858b05800c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.221971 Sep 01 08:51:43.902699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2596/5217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:43 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:44.922914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:44.923521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:44.929463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:44.929984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:44.930441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:44.931134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:44.931569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:44.932259 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:44.990793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:44.998419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ee62552-cf65-4ebf-b43e-35d30c1487fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079292 Sep 01 08:51:44.998972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2622/5218] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:44 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:46.018882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:46.019497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:46.026213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:46.026722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:46.027157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:46.027839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:46.028300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:46.028723 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:46.093048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:46.100595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d8d4b5b2-5fc6-4256-b183-de979a5730ff tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085518 Sep 01 08:51:46.101985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2597/5219] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:46 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:47.121690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:47.122318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:47.128313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:47.128795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:47.129229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:47.129910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:47.130387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:47.130811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:47.189792 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:47.197342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-72880289-23ce-4660-a0ff-02641e9446a9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079518 Sep 01 08:51:47.197897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2623/5220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:47 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:48.216845 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:48.217478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:48.223749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:48.224220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:48.224646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:48.225317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:48.226373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:48.226853 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:48.286907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:48.294968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-503d8871-9d2d-450e-9885-175e081260f8 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081971 Sep 01 08:51:48.295531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2598/5221] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:48 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:49.316167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:49.316799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:49.323599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:49.324085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:49.324520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:49.325220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:49.325668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:49.326092 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:49.403994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:49.411714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7a2cdf64-f671-436c-8e27-f695c42004b2 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.099644 Sep 01 08:51:49.412278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2624/5222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:49 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:50.436558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:50.437178 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:50.443110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:50.443585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:50.444026 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:50.445212 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:50.445667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:50.446084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:50.448637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:50.504548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:50.512487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6105087d-4a5c-4013-80c0-ba0c9dbfbdd7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079777 Sep 01 08:51:50.513040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2599/5223] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:50 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:51.533674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:51.534287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:51.540276 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:51.540741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:51.541164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:51.541831 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:51.542285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:51.542707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:51.601369 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:51.608797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-861b306d-b5bd-4b05-bb6a-ebca86b04838 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.078933 Sep 01 08:51:51.609349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2625/5224] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:51 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:52.629507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:52.630112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:52.636282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:52.636759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:52.637198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:52.637875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:52.638344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:52.638765 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:52.701443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:52.708989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b3d3454-f1f5-466a-9ea3-1cdcc40d65d9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083324 Sep 01 08:51:52.709541 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2600/5225] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:52 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:53.730224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:53.730803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:53.736742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:53.737220 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:53.737654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:53.738359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:53.738816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:53.739239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:53.800293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:53.808039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09a10233-ad97-47fa-a1ca-75f9e3be66d1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082787 Sep 01 08:51:53.808595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2626/5226] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:53 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:54.828226 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:54.828831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:54.834827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:54.835305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:54.835737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:54.836417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:54.836865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:54.837287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:54.896289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:54.903970 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1b2a1877-faec-4972-ab39-02bb0c63a9ae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079615 Sep 01 08:51:54.904529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2601/5227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:54 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:55.925096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:55.925843 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:55.927935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:55.934022 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:55.934533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:55.934964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:55.935648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:55.936096 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:55.936514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:55.939124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:55.995860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:56.003281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0747e202-4de9-4ce1-877c-a311c13a0864 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082215 Sep 01 08:51:56.003835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2627/5228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:55 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:57.024291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:57.024932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:57.026827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:57.032457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:57.032929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:57.033354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:57.034027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:57.034500 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:57.034919 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:57.095783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:57.103836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f8ebfcfb-fbb9-4ff0-8868-d8a2a7476de9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083981 Sep 01 08:51:57.104386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2602/5229] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:57 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:58.124756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:58.125358 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:58.131226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:58.131693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:58.132114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:58.132778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:58.133436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:58.133907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:58.193186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:58.200637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-50c937c3-8502-4690-8496-eee6b8daf36f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079764 Sep 01 08:51:58.201192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2628/5230] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:58 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:51:59.220722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:51:59.221326 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:51:59.228034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:59.228509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:59.228945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:59.229621 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:51:59.230069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:51:59.230519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:51:59.288289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:51:59.296443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5cf5afd7-3bbb-44b7-a4b3-fc7a66c28ca7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079570 Sep 01 08:51:59.296998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2603/5231] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:51:59 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:00.316849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:00.317460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:00.323479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:00.323951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:00.324379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:00.325055 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:00.325500 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:00.325917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:00.388287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:00.395723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f853b7bc-162f-46c2-b21d-75eb38c7aeb5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082700 Sep 01 08:52:00.396274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2629/5232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:00 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:01.416459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:01.417090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:01.422950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:01.423421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:01.423846 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:01.424514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:01.424957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:01.425372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:01.487999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:01.495713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4d42662f-dbe7-4a2c-a5f3-1610579d8d3c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083636 Sep 01 08:52:01.496266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2604/5233] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:01 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:02.516288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:02.516894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:02.522790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:02.523265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:02.523704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:02.524549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:02.524997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:02.525415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:02.584245 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:02.591781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18dd5373-29eb-4d1e-aa14-401beb006b25 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079304 Sep 01 08:52:02.592328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2630/5234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:02 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:03.612413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:03.613017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:03.619599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:03.620079 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:03.620512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:03.621193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:03.621639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:03.622061 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:03.680502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:03.688214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-525531c3-bbc5-4de1-be6e-d73232de8dac tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079692 Sep 01 08:52:03.688761 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2605/5235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:03 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:04.709390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:04.709979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:04.716640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:04.717111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:04.717565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:04.718288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:04.718732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:04.719144 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:04.778244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:04.785674 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dd357801-a83c-4b56-b04c-58a26d08dc2e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080283 Sep 01 08:52:04.786221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2631/5236] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:04 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:05.807036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:05.807646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:05.813661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:05.814138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:05.814611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:05.815287 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:05.815734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:05.816152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:05.878053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:05.886645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ed617fad-014e-4347-a3ca-559b79756959 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084224 Sep 01 08:52:05.887198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2606/5237] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:05 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:06.907309 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:06.907949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:06.914438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:06.915174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:06.915614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:06.916298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:06.916751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:06.917176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:06.975748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:06.986102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bf045f1f-4d6f-4a45-94b9-640cdc9a69a4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082582 Sep 01 08:52:06.986768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2632/5238] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:06 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:52:08.011408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:08.012017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:08.017901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:08.018411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:08.018844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:08.019526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:08.019974 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:08.020398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:08.080454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:08.087832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3d993479-3538-45fe-9243-bff75cd6d468 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080959 Sep 01 08:52:08.088387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2607/5239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:08 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:09.107143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:09.107746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:09.113622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:09.114098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:09.114562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:09.115258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:09.115707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:09.116120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:09.175196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:09.183578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-286d2156-d153-4e93-9bd0-f2ecb23108b4 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080246 Sep 01 08:52:09.184135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2633/5240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:10.203279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:10.203813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:10.209711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:10.210191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:10.210655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:10.211337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:10.211788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:10.212208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:10.274279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:10.281718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3edfc889-e8a8-471b-a5e3-88e8458c45a3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082386 Sep 01 08:52:10.282278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2608/5241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:10 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:11.302568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:11.303173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:11.309398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:11.309870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:11.310321 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:11.310995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:11.311433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:11.311848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:11.370597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:11.377975 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6411fc98-cad4-4b92-b9e2-f8496d2d90c0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079249 Sep 01 08:52:11.378559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2634/5242] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:11 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:12.398477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:12.399248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:12.405205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:12.405683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:12.406116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:12.406830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:12.407283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:12.407708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:12.467515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:12.475119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3ae700a-283d-4239-968e-d5c56b868786 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080603 Sep 01 08:52:12.475683 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2609/5243] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:12 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:13.496827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:13.497437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:13.503269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:13.503745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:13.504173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:13.504846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:13.505290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:13.505705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:13.564825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:13.572984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e32b9b9f-e8d7-410a-b3be-e80f10231860 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079941 Sep 01 08:52:13.573533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2635/5244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:13 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:14.592867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:14.593474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:14.599589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:14.600072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:14.600506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:14.601192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:14.602244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:14.602833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:14.663704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:14.671821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8f032468-4002-4fb8-bc1e-919109717d47 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082817 Sep 01 08:52:14.672379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2610/5245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:14 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:15.693206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:15.693765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:15.699947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:15.700418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:15.700846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:15.701523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:15.701968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:15.702407 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:15.761766 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:15.769256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5682a2d-6455-4c38-a837-9d806dd9f23b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080053 Sep 01 08:52:15.769811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2636/5246] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:15 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:16.790984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:16.791596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:16.797528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:16.798015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:16.798497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:16.799184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:16.799635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:16.800056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:16.859357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:16.867602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be68bf30-119e-48ba-8ea1-b6ea75252725 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080577 Sep 01 08:52:16.868161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2611/5247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:16 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:17.887840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:17.888449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:17.894448 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:17.894923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:17.895349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:17.896026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:17.896472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:17.896891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:17.955860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:17.963887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7cb4a84e-dc27-4472-8fda-39369caabdcf tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079848 Sep 01 08:52:17.964445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2637/5248] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:17 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:18.984623 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:18.985228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:18.991127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:18.991599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:18.992674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:18.993455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:18.993936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:18.994399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:19.056921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:19.064389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0ae180de-40bb-46d1-ade1-659585be7021 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083647 Sep 01 08:52:19.064939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2612/5249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:18 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:20.084174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:20.084783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:20.091274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:20.091748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:20.092176 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:20.092850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:20.093298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:20.093716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:20.152177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:20.159576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e9775793-74ff-4df6-9cff-0b66c5cf8583 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079296 Sep 01 08:52:20.160134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2638/5250] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:20 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:21.184524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:21.185117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:21.191121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:21.191601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:21.192034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:21.192715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:21.193160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:21.193586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:21.197532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:21.253336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:21.260927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d8fbef1a-4955-4628-af46-273c7ea46ea0 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080522 Sep 01 08:52:21.261559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2613/5251] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:21 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:22.281241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:22.281865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:22.288065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:22.288620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:22.289107 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:22.289869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:22.290338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:22.290759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:22.351788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:22.359293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-784d3f5a-10a8-4fd7-a30e-e71d6924056c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081870 Sep 01 08:52:22.359846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2639/5252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:22 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:23.379086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:23.379694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:23.386312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:23.386795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:23.387227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:23.387901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:23.388348 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:23.388768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:23.451227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:23.458757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5658ee5c-0237-4ef3-b1b1-48f3c4a9c549 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083481 Sep 01 08:52:23.459318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2614/5253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:23 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:24.479929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:24.480534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:24.486685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:24.487165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:24.487625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:24.488306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:24.488781 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:24.489207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:24.550798 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:24.559204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e122c268-c2c2-41eb-8dcc-3e245d72071c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083436 Sep 01 08:52:24.559769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2640/5254] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:24 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:25.579524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:25.580128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:25.586207 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:25.586714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:25.587144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:25.587828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:25.588273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:25.588690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:25.648488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:25.655953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b918431e-d2b7-4f67-a35f-9970e042dcf1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080256 Sep 01 08:52:25.656618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2615/5255] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:25 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:26.677226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:26.677756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:26.679636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:26.685227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:26.685703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:26.686136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:26.686839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:26.687288 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:26.687708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:26.691504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:26.747380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:26.755130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0c4f24ee-3db2-47c5-9fde-5a05608282c3 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081699 Sep 01 08:52:26.755718 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2641/5256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:26 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:27.776728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:27.777286 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:27.779389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:27.784660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:27.785137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:27.785566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:27.786240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:27.786735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:27.787150 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:27.849302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:27.857662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5fd87d92-1b05-4f1c-980d-4b455d29aaf7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085369 Sep 01 08:52:27.858214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2616/5257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:27 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:28.878049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:28.878692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:28.885464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:28.885939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:28.886406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:28.887081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:28.887528 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:28.887946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:28.947375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:28.954801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2d4b5790-f215-426f-83d5-48151faec079 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080571 Sep 01 08:52:28.955380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2642/5258] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:28 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:29.976030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:29.976775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:29.982639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:29.983110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:29.983535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:29.984202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:29.984643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:29.985058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:30.045112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:30.052564 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-be3dd54a-7527-4560-82d1-52fff98d7e0f tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080420 Sep 01 08:52:30.053109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2617/5259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:29 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:31.072887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:31.073488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:31.079506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:31.079981 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:31.080404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:31.081067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:31.081510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:31.081924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:31.141967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:31.149791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-74973624-c367-4b09-8557-099c814eefae tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080806 Sep 01 08:52:31.150361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2643/5260] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:31 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:32.170339 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:32.170939 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:32.176752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:32.177225 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:32.177650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:32.178336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:32.178815 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:32.179228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:32.241049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:32.248599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-95452bde-79a2-4100-84bb-56133727cea6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082067 Sep 01 08:52:32.249143 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2618/5261] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:32 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:33.268796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:33.269396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:33.275549 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:33.276020 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:33.276445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:33.277113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:33.277553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:33.277966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:33.337269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:33.345389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b3747657-e91d-4b87-9e9f-e5652cf87092 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080476 Sep 01 08:52:33.345940 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2644/5262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:33 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:34.364928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:34.365555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:34.371509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:34.371989 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:34.372419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:34.373091 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:34.373568 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:34.373987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:34.433122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:34.440680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-19fb4fbd-e5ab-45de-8a35-5f48274aa19a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079598 Sep 01 08:52:34.441244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2619/5263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:34 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:35.463132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:35.463733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:35.470218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:35.470723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:35.471148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:35.472283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:35.472283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:35.472643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:35.531380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:35.539121 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7adc3707-a702-49ad-84a0-4cfd8934236c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080008 Sep 01 08:52:35.539672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2645/5264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:35 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:36.560898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:36.561505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:36.567453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:36.567940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:36.568363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:36.569033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:36.570105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:36.570558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:36.632469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:36.639876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-12b52ff1-d4c9-416e-990d-8fe593fb77af tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082813 Sep 01 08:52:36.640436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2620/5265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:36 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:37.660957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:37.661496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:37.667956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:37.668435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:37.668867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:37.669546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:37.669999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:37.670452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:37.731265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:37.738776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-efe29eb5-84ea-4ba2-b7b9-e6cfc01c2c9d tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081660 Sep 01 08:52:37.739335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2646/5266] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:37 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:38.760377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:38.760894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:38.766962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:38.767441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:38.767875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:38.768549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:38.768995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:38.769415 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:38.828941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:38.836562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-adfe8a5b-9dd3-44a7-be08-0fa46808e946 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080589 Sep 01 08:52:38.837115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2621/5267] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:38 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:39.856591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:39.857192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:39.859164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:52:39.859292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:52:39.865488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:39.865957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:39.866979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:39.867665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:39.868105 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:39.868515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:39.929821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:39.937562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d48c83bf-586d-4d53-acab-126cb69ccf9c tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.084831 Sep 01 08:52:39.938132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2647/5268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:39 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:40.958833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:40.959458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:40.965692 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:40.966170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:40.966634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:40.967335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:40.967783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:40.968200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:41.030230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:41.039007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f9fb9bf0-29c7-44b4-ac8d-0cca2fc4e61a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083266 Sep 01 08:52:41.039561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2622/5269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:40 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:42.060263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:42.060868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:42.066867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:42.067342 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:42.067765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:42.068441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:42.068886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:42.069956 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:42.129357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:42.137789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-851a49ac-d392-4199-a158-d643e2a6f962 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081440 Sep 01 08:52:42.138367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2648/5270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:42 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:43.157951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:43.158585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:43.164525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:43.164994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:43.165419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:43.166090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:43.166574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:43.166988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:43.227960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:43.235491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a2f51aac-b0b4-4832-94ea-bd25b2204e5e tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081367 Sep 01 08:52:43.236123 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2623/5271] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:43 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:44.255256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:44.255846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:44.262354 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:44.262827 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:44.263249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:44.263916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:44.264359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:44.264772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:44.323890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:44.331271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-318b5dd8-709d-4b6a-ad65-312a1c1d4b05 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079774 Sep 01 08:52:44.331830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2649/5272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:44 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:45.352030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:45.352646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:45.358573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:45.359051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:45.359486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:45.360159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:45.360608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:45.361027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:45.422651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:45.430195 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-324e586d-1d55-48ea-91d2-a30cc06d9a0b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082181 Sep 01 08:52:45.431046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2624/5273] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:45 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:46.452183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:46.452812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:46.458650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:46.459119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:46.459541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:46.460837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:46.461283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:46.461698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:46.519816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:46.527854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-539d611f-b0ec-4c2f-a5df-72269cff0e09 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079454 Sep 01 08:52:46.528414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2650/5274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:46 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:47.548608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:47.549218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:47.556101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:47.556573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:47.556999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:47.557664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:47.558104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:47.558571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:47.617719 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:47.625076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e9000a1f-f280-4239-9590-229e3db080fb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080406 Sep 01 08:52:47.625626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2625/5275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:47 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:48.645918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:48.646553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:48.653208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:48.653684 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:48.654114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:48.654823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:48.655278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:48.655690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:48.714018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:48.721478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f146078a-341f-44ea-9811-6446d3b54788 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079270 Sep 01 08:52:48.721972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2651/5276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:48 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:49.743045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:49.743609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:49.749565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:49.750041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:49.750509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:49.751196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:49.751642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:49.752060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:49.813797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:49.821927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-70cd9329-7490-466e-b7b1-ccbd4f1d3fc6 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083139 Sep 01 08:52:49.822502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2626/5277] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:49 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:50.842750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:50.843357 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:50.849285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:50.849760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:50.850286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:50.850960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:50.851408 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:50.851826 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:50.911089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:50.922032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b057d16-fd0c-468d-8236-c19086861954 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083088 Sep 01 08:52:50.922648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2652/5278] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:50 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:51.943524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:51.944810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:51.950944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:51.951425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:51.951863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:51.952549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:51.952999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:51.953421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:51.956053 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:52.018715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:52.027126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1e0b9e11-f2c3-4e08-b3be-78aaf96500d5 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.087417 Sep 01 08:52:52.027795 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2627/5279] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:51 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:53.056964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:53.057620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:53.065181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:53.065657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:53.066088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:53.066867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:53.067319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:53.067743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:53.126797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:53.134750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3a718188-d4b0-40f1-8a88-bdf34a4f3f6a tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083384 Sep 01 08:52:53.135311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2653/5280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:53 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:54.154867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:54.155503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:54.161363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:54.161836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:54.162285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:54.163559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:54.164040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:54.164459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:54.226289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:54.233649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-13d93a9f-cc59-41cb-adbc-df5457fc8ab1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082569 Sep 01 08:52:54.234276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2628/5281] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:54 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:55.254062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:55.254753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:55.261129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:55.261589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:55.262010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:55.262703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:55.263145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:55.263559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:55.324610 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:55.332118 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fdf9bd62-500f-4b42-87e1-fba6ff2542cb tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.081882 Sep 01 08:52:55.332675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2654/5282] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:55 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:56.351585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:56.352205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:56.358023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:56.358531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:56.358965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:56.359636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:56.360085 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:56.360504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:56.420233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:56.427872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4716e214-0735-4cfa-84c9-652be24af161 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080176 Sep 01 08:52:56.429118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2629/5283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:56 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:57.449238 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:57.449839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:57.451661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:57.456853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:57.457324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:57.457749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:57.458447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:57.458889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:57.459923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:57.462572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:57.519869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:57.527814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1fa3339b-b371-4502-ab23-36d3660816fd tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082345 Sep 01 08:52:57.528372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2655/5284] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:57 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:58.548555 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:58.549162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:58.551011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:52:58.557045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:58.557524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:58.557953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:58.558651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:58.559099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:58.559519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:58.621112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:58.628519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f8ddc029-0b52-4bcb-bfcd-ab90e227299b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083770 Sep 01 08:52:58.629105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2630/5285] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:58 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:52:59.649950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:52:59.650573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:52:59.656452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:59.656923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:59.657351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:59.658019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:52:59.658491 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:52:59.658907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:52:59.718800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:52:59.728928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-43bad819-108c-4038-bd3d-8684b2886689 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.082697 Sep 01 08:52:59.728928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2656/5286] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:52:59 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:00.748742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:00.749296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:00.755295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:00.755772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:00.756240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:00.756975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:00.757420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:00.757844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:00.816612 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:00.824041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-72aae0c3-8026-44a1-9f65-41e855f402ad tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079211 Sep 01 08:53:00.824597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2631/5287] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:00 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:01.844437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:01.845074 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:01.851730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:01.852235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:01.852665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:01.853372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:01.853842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:01.854285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:01.912687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:01.920789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4baf01c8-51dd-42dd-afa3-5e21c2067a5b tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080212 Sep 01 08:53:01.921348 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2657/5288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:01 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:02.941844 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:02.942479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:02.948347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:02.948821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:02.949251 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:02.949926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:02.950408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:02.950831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:03.015549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:03.023524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c3307b15-70b0-48ee-b05b-972b168e70e1 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.085447 Sep 01 08:53:03.024089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2632/5289] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:02 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:04.044521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:04.045157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:04.051131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:04.051601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:04.052028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:04.052723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:04.053153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:04.054187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:04.112365 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:04.120291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-96fd77cb-ea29-4bb1-81ac-b0a931c84a99 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079644 Sep 01 08:53:04.120849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2658/5290] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:04 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:53:05.140421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:05.141030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:05.146941 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:05.147930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:05.148362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:05.149038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:05.149486 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:05.149903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:05.208172 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:05.216093 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e05eeea1-58ac-4a0d-8d97-dfce6ed0eb58 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079507 Sep 01 08:53:05.216646 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2633/5291] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:05 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:06.236906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:06.237546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:06.244029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:06.244502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:06.244933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:06.245607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:06.246054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:06.246506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:06.305837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:06.313331 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-526a2343-3e0d-4fd0-a198-430f527300fe tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.080207 Sep 01 08:53:06.313885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2659/5292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:06 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:07.332899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:07.333532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:07.336057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:53:07.336191 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:53:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:53:07.337170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:53:07.337280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:53:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:53:07.345870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:07.346386 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:07.346820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:07.347502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:07.347950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:07.348369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:07.412075 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:07.420379 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ac5973e-9867-4aa5-87f1-c5112e4b2b92 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.091283 Sep 01 08:53:07.420901 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2634/5293] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:07 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:08.441689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:08.442310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:08.444813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:53:08.444947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e (ip 10.222.0.43) !!! Sep 01 08:53:08.451335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:08.451809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:08.452271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:08.452990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:08.453454 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:08.453874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:08.514296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:08.521639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7d58580f-1253-43ba-b614-c685d977eb73 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.083786 Sep 01 08:53:08.522837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2660/5294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:08 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:09.542563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:09.543166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:09.549054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:09.549527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:09.549954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:09.550661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:09.551102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:09.551513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:09.610144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b80c8db57f466ab4260d2a2774d96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b100830711488eaccc36e6452e393b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:09.618082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6b7130c3-cfca-4116-be62-4e62851c60b9 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 200 len: 1218 microversion: 2.1 time: 0.079381 Sep 01 08:53:09.618672 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2635/5295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:53:09.637738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:09.638215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:09.644012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:09.644482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:09.644912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:09.645605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:09.646052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:09.646495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:09.669553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:53:09.678195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:09.679293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:09.679720 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:09.692031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lazy-loading 'flavor' on Instance uuid 65e12992-6c25-4f87-aa6c-a00605cd4c1e {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:53:09.703459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lazy-loading 'system_metadata' on Instance uuid 65e12992-6c25-4f87-aa6c-a00605cd4c1e {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:53:09.719625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lazy-loading 'metadata' on Instance uuid 65e12992-6c25-4f87-aa6c-a00605cd4c1e {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:53:09.941668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Deleted allocations for instance 65e12992-6c25-4f87-aa6c-a00605cd4c1e Sep 01 08:53:09.957597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-599e43e8-7de1-418b-9159-19b1d9143b80 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "DELETE /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 204 len: 0 microversion: 2.1 time: 0.323607 Sep 01 08:53:09.958208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2661/5296] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:53:09 2022] DELETE /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 08:53:09.966830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:09.967454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] [instance: 65e12992-6c25-4f87-aa6c-a00605cd4c1e] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:09.973219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:09.973807 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:09.974238 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:09.974930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:09.975400 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:09.975830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:09.988924 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] HTTP exception thrown: Instance 65e12992-6c25-4f87-aa6c-a00605cd4c1e could not be found. Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Request method failure captured: Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e HTTP/1.1 Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEHAgOMkDDQz21q81UWYvZqd_AOfJ4vZjZoa0N_oDNOXZZ7xEkEzDF5XPVAKZbeUuzS-qnfQoTfghqbbkymfLTcS4MVVsaHgyPx_dYw_hXx-rNhgd2EaR1O54Gk9Y88FM2aPXntG0Fd_BKn14_1kZIoDOhd4TZZGEbaAB_kxfXihCldY Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: 25b100830711488eaccc36e6452e393b Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-VolumesActionsTest-1507503638 Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:53:09.990481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25b100830711488eaccc36e6452e393b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25b100830711488eaccc36e6452e393b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25b100830711488eaccc36e6452e393b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25b100830711488eaccc36e6452e393b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-VolumesActionsTest-1507503638 Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: 25b100830711488eaccc36e6452e393b Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-VolumesActionsTest-1507503638 Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-VolumesActionsTest-1507503638-project Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: b3b80c8db57f466ab4260d2a2774d96c Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-VolumesActionsTest-1507503638-project Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance 65e12992-6c25-4f87-aa6c-a00605cd4c1e could not be found. Sep 01 08:53:09.991836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '65e12992-6c25-4f87-aa6c-a00605cd4c1e'} Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e12992-6c25-4f87-aa6c-a00605cd4c1e could not be found. Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:53:09.992542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e12992-6c25-4f87-aa6c-a00605cd4c1e could not be found. Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e12992-6c25-4f87-aa6c-a00605cd4c1e could not be found. Sep 01 08:53:09.994176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:53:09.995590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] Returning 404 to user: Instance 65e12992-6c25-4f87-aa6c-a00605cd4c1e could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:53:09.995590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8979d054-ba1d-4605-9e32-b2bb7edb9fe7 tempest-VolumesActionsTest-1507503638 tempest-VolumesActionsTest-1507503638-project] 10.222.0.43 "GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e" status: 404 len: 111 microversion: 2.1 time: 0.028967 Sep 01 08:53:09.995590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2636/5297] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:09 2022] GET /compute/v2.1/servers/65e12992-6c25-4f87-aa6c-a00605cd4c1e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 08:53:43.528993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:43.531202 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:43.738719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-09c67d24-1f4f-4418-b53a-a853f5513548 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Action: 'create', calling method: .version_select at 0x7f2abf7f3310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1087839153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYMHlhEydY3mAbWN+PUhwiCvB7tHJUoJ+o0ROS5X8m/GYSY+aOl35RKxWPq9vODQyf/FnkkG7XYDVW5mXFKemR/AZAaWqgf6h3f9DLGxlubSusp5bgc0Cubi54/mnSv1Q=="}} {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:53:43.759147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-09c67d24-1f4f-4418-b53a-a853f5513548 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Getting quotas for project 080a584184d2447bad65232e948ee0e0. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:53:43.762920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.quota [None req-09c67d24-1f4f-4418-b53a-a853f5513548 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Getting quotas for user 3979dd9da28948c584d0eabbc7ef9559 and project 080a584184d2447bad65232e948ee0e0. Resources: {'key_pairs'} {{(pid=120753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:53:43.791184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-09c67d24-1f4f-4418-b53a-a853f5513548 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.268456 Sep 01 08:53:43.792280 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2662/5298] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Sep 1 08:53:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 08:53:58.997728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1638817851", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1087839153", "security_groups": [{"name": "tempest-secgroup-smoke-1124745416"}], "block_device_mapping_v2": [{"uuid": "ed0e69d6-e9a3-4745-bc05-637d0770ef5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec020d4a-42d8-403f-abe8-caa5ec49f778"}]}} {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 08:53:59.007914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=13 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:59.008726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=55 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:59.111401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.network.neutron [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] validate_networks() for [('ec020d4a-42d8-403f-abe8-caa5ec49f778', None, None, None, None, None)] {{(pid=120752) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 08:53:59.566532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Flavor limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 08:53:59.566949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Image limits 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 08:53:59.567411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Flavor pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 08:53:59.567814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Image pref 0:0:0 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 08:53:59.568252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.virt.hardware [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 08:53:59.577496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:59.577967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:59.578439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:59.579149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:53:59.579595 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:53:59.580013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:53:59.596961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Getting quotas for project 080a584184d2447bad65232e948ee0e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 08:53:59.601406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.quota [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Getting quotas for user 3979dd9da28948c584d0eabbc7ef9559 and project 080a584184d2447bad65232e948ee0e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120752) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 08:53:59.656517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Going to run 1 instances... {{(pid=120752) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 08:53:59.658638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed0e69d6-e9a3-4745-bc05-637d0770ef5c',volume_size=None,volume_type=None)] {{(pid=120752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 08:53:59.788642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46713499-b72c-4f74-894f-3908f6843d1d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794610 Sep 01 08:53:59.789340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2637/5299] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Sep 1 08:53:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 08:53:59.796891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=4 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:59.797699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:59.802517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-14b09e13-d3a0-4a24-8ca3-ab0bd513ef78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:53:59.803156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-14b09e13-d3a0-4a24-8ca3-ab0bd513ef78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:53:59.868534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-14b09e13-d3a0-4a24-8ca3-ab0bd513ef78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:53:59.875223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-14b09e13-d3a0-4a24-8ca3-ab0bd513ef78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1095 microversion: 2.1 time: 0.079095 Sep 01 08:53:59.875713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2663/5300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:53:59 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:00.895580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:00.896187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:00.902378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:00.902850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:00.903278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:00.903953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:00.904396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:00.904809 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:00.964987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:00.972496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b70a707b-a1aa-44bf-b872-cc315d27411b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080740 Sep 01 08:54:00.973050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2638/5301] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:00 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:01.993427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:01.994033 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:01.999959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:02.000435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:02.000862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:02.001536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:02.001985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:02.002435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:02.065668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:02.073968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c479bfe8-5a4a-4adc-b894-7d4f715757d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084874 Sep 01 08:54:02.074550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2664/5302] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:01 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:03.094496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:03.095096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:03.101569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:03.102036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:03.102488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:03.103158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:03.103602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:03.104017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:03.164509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:03.171957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a4d507a-0fff-4012-96bd-9eaaf894262f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081377 Sep 01 08:54:03.172509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2639/5303] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:03 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:04.192915 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:04.194095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:04.199947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:04.200420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:04.200844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:04.201513 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:04.201955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:04.202466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:04.261900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:04.269483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4b1863af-b83b-43e3-b773-81713579e7d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080457 Sep 01 08:54:04.270036 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2665/5304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:04 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:05.289731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:05.290357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:05.296293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:05.296772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:05.297203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:05.297879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:05.298356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:05.298777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:05.358135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:05.366248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-05c009f4-450d-4d52-ab9c-8eda04955182 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079898 Sep 01 08:54:05.366820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2640/5305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:05 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:06.386476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:06.387110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:06.392968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:06.393446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:06.393874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:06.394580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:06.395028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:06.395444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:06.456897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:06.465198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-53710e89-9849-4dad-bd8d-6088f7e99635 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082571 Sep 01 08:54:06.465760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2666/5306] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:06 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:07.488169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:07.488775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:07.494962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:07.495441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:07.495877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:07.496560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:07.497006 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:07.497426 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:07.557164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:07.564641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5b385315-1e50-4955-9eed-e87094962591 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080245 Sep 01 08:54:07.565196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2641/5307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:07 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:08.585353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:08.585944 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:08.591930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:08.592403 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:08.592834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:08.593502 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:08.593945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:08.594392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:08.652439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:08.659914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-378fa6fc-c719-4e21-858f-de8f9cebf8d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078947 Sep 01 08:54:08.660462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2667/5308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:08 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:09.680784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:09.681330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:09.683169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=2 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:09.683959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell0:SELECT=6 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:09.689282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:09.689757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:09.690188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:09.690890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:09.691338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:09.691757 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:09.757282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:09.764953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09f3c3b8-084d-49a6-bf1f-ebcfa799842a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.088299 Sep 01 08:54:09.765513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2642/5309] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:09 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:10.784760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:10.785363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:10.787783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell0:SELECT=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:10.793070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:10.793548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:10.793982 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:10.794686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:10.795135 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:10.795556 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:10.857272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:10.864776 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-41d5372b-9e1f-4d1c-ab2a-f0d4df0a7c93 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083809 Sep 01 08:54:10.865953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2668/5310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:10 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:11.885870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:11.886509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:11.892395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:11.892870 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:11.893307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:11.893983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:11.894456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:11.894874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:11.953979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:11.962099 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-68a54e47-56d8-4099-9e74-8dd1767a182e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080109 Sep 01 08:54:11.962685 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2643/5311] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:11 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:12.982993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:12.983626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:12.989501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:12.990734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:12.991215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:12.991879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:12.992320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:12.992731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:13.050603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:13.058912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c82c2600-4578-472f-93c9-db34b42f2fb2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079771 Sep 01 08:54:13.059459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2669/5312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:12 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:14.079052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:14.079665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:14.085681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:14.086158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:14.086614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:14.087294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:14.087743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:14.088162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:14.147034 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:14.154409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d4f1ec9e-acce-491b-ae1e-fc492408a3cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079212 Sep 01 08:54:14.154961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2644/5313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:14 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:15.173804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:15.174434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:15.181351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:15.181823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:15.182249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:15.182939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:15.183382 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:15.183794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:15.245146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:15.252657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-872c62ce-ba50-46ec-9b4d-0857cedb5bc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082650 Sep 01 08:54:15.253198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2670/5314] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:15 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:16.272750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:16.273383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:16.279297 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:16.279774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:16.280209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:16.280886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:16.281334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:16.281760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:16.340408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:16.347821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a967a4b7-7292-46ce-8afd-699ab3f2e8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078988 Sep 01 08:54:16.348377 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2645/5315] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:16 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:17.368912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:17.369514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:17.375375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:17.375853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:17.376281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:17.376949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:17.377393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:17.377808 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:17.436419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:17.444077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d9b5a13a-547f-4ecf-a894-e02951c50987 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079501 Sep 01 08:54:17.444652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2671/5316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:17 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:18.464983 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:18.466462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:18.472586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:18.473066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:18.473498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:18.474181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:18.474696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:18.475115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:18.533657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:18.541308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a226f907-2ed1-4460-9ba9-43da8b48dca2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080160 Sep 01 08:54:18.541857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2646/5317] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:18 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:19.562301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:19.562895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:19.569415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:19.569885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:19.570327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:19.570997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:19.571441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:19.571851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:19.633108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:19.640628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3e6e61f2-9b59-4906-a2e0-9dbae1bd2e1f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082286 Sep 01 08:54:19.641186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2672/5318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:19 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:20.662252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:20.662931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:20.669385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:20.669869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:20.670323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:20.671004 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:20.671447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:20.671859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:20.731654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:20.739166 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a133ca8d-a6aa-4eb6-a654-026bf1ae7a36 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080764 Sep 01 08:54:20.739754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2647/5319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:20 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:21.759995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:21.760580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:21.766719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:21.767198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:21.767628 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:21.768302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:21.768749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:21.769200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:21.828108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:21.836244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8dcd0dc0-04df-499a-8272-e486d7a7fde4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080376 Sep 01 08:54:21.836801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2673/5320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:21 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:22.856543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:22.857188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:22.863126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:22.863593 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:22.864018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:22.864686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:22.865754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:22.866167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:22.924820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:22.933409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1e4230ca-5907-4269-802d-0626aaca754e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080813 Sep 01 08:54:22.933963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2648/5321] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:22 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:23.953034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:23.953649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:23.960424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:23.960911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:23.961349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:23.962057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:23.962545 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:23.962973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:24.025466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:24.033050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3e0fc7b5-d651-4eb4-a6e4-78df96abd44e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083973 Sep 01 08:54:24.033620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2674/5322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:23 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:25.054994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:25.055585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:25.061521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:25.061997 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:25.062465 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:25.063141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:25.063588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:25.064015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:25.124709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:25.132262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-adf8a4dc-9f7a-41d3-99af-34479ea582fe tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082144 Sep 01 08:54:25.132824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2649/5323] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:25 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:26.152680 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:26.153284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:26.159227 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:26.159699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:26.160125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:26.160801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:26.161267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:26.161669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:26.221731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:26.229412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-79e53200-276f-4631-9ffd-5c1dcb19b22d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080623 Sep 01 08:54:26.229973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2675/5324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:26 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:27.249408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:27.250009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:27.256394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:27.256863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:27.257288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:27.257954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:27.258428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:27.258868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:27.317439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:27.326185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b156424a-b8db-45b3-8069-93bc0258b6a3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080560 Sep 01 08:54:27.326768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2650/5325] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:27 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:28.347717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:28.348319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:28.355291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:28.355772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:28.356200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:28.356877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:28.357319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:28.357731 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:28.419296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:28.426803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38bedcad-c0b3-4518-9e11-ca8070996e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082916 Sep 01 08:54:28.427455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2676/5326] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:28 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:29.448211 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:29.448748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:29.450575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:29.455653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:29.456131 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:29.456563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:29.457248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:29.457699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:29.458116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:29.462088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=81 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:29.518966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:29.527167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3e9052d3-7298-4293-9eba-c8ee0de85dda tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083533 Sep 01 08:54:29.527726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2651/5327] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:29 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:30.547645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:30.548247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:30.550075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=31 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:30.556214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:30.556691 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:30.557117 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:30.557785 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:30.558232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:30.558693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:30.561312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=79 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:30.618116 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:30.625544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0ef4c845-3464-4dd0-9f8e-4bf8c84bf8bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081678 Sep 01 08:54:30.626098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2677/5328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:30 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:31.647702 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:31.648316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:31.654382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:31.654864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:31.655294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:31.655988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:31.656419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:31.656839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:31.715839 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:31.723510 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ab801eb9-42f3-4f2e-8675-6235d79613c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080225 Sep 01 08:54:31.724005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2652/5329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:31 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:32.743392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:32.743932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:32.749994 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:32.750510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:32.750942 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:32.751619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:32.752070 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:32.752490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:32.814175 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:32.821730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6f928876-2677-4409-b883-fd79715e965e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082450 Sep 01 08:54:32.822304 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2678/5330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:32 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:33.841147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:33.841755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:33.847669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:33.848144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:33.848577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:33.849248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:33.849693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:33.850699 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:33.908657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:33.916611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-784e0e05-d5e9-4493-8c39-bfb3029f39d2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079272 Sep 01 08:54:33.917164 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2653/5331] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:33 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:34.936662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:34.937270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:34.943178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:34.943651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:34.944077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:34.945423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:34.945865 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:34.946297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:35.004404 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:35.012664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-87fa3c13-a153-4cce-9383-1d1280931199 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079754 Sep 01 08:54:35.013223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2679/5332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:34 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:36.033293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:36.033897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:36.040455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:36.040927 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:36.041515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:36.042194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:36.042728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:36.043294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:36.102000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:36.109381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1696334f-0075-43dc-9538-a8d666a1a7c1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079964 Sep 01 08:54:36.110011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2654/5333] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:36 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:37.129656 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:37.130195 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:37.136570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:37.137039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:37.137462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:37.138131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:37.138602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:37.139018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:37.200779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:37.208167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1a0341bf-7d38-43a6-81fd-e8071196d043 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082464 Sep 01 08:54:37.208716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2680/5334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:37 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:38.229271 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:38.229866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:38.235785 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:38.236255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:38.236681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:38.237349 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:38.237790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:38.238202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:38.296574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:38.304428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3bdcb297-528a-4db4-9798-a46510ecfbf0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079683 Sep 01 08:54:38.304980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2655/5335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:38 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:39.325379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:39.325978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:39.331910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:39.332383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:39.332811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:39.333501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:39.333946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:39.334385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:39.393547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:39.401666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85bec661-9cfd-4908-ae38-f79f28dc7b76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080179 Sep 01 08:54:39.402219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2681/5336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:39 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:40.421722 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:40.422358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:40.428664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:40.429161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:40.429615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:40.430323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:40.430804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:40.431229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:40.494119 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:40.501878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a8842cab-57dc-49e8-a6c5-bb400a4db094 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084012 Sep 01 08:54:40.502467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2656/5337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:40 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:41.522023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:41.522842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:41.528677 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:41.529152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:41.529581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:41.530275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:41.530734 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:41.531152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:41.593265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:41.601307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ef1ff877-e855-48fc-a6c9-03b534d1ebfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082608 Sep 01 08:54:41.601866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2682/5338] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:41 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:42.622283 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:42.622895 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:42.628789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:42.629257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:42.629681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:42.630376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:42.630817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:42.631232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:42.689787 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:42.697885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f188952f-54c4-417b-9f8d-aa93a79ca572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079427 Sep 01 08:54:42.698458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2657/5339] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:42 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:43.717800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:43.718434 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:43.724498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:43.724923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:43.725939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:43.726555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:43.727012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:43.727428 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:43.785921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:43.794066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f024de69-1a97-4ea3-902d-e8a2b0deea6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080130 Sep 01 08:54:43.794646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2683/5340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:43 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:44.814709 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:44.815315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:44.821260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:44.821741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:44.822173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:44.822880 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:44.823327 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:44.823748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:44.883096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:44.890611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1908055-5513-4641-9b90-7491abb758ab tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079720 Sep 01 08:54:44.891491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2658/5341] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:44 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:45.911120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:45.911753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:45.917576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:45.918046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:45.918516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:45.919186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:45.919629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:45.920045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:45.980874 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:45.988415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-58781347-fa12-4ae1-9ff1-4de78e2289be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081108 Sep 01 08:54:45.988964 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2684/5342] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:45 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:47.008711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:47.009304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:47.015979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:47.016450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:47.016878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:47.017549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:47.017992 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:47.018506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:47.077842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:47.085847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-56e27309-7b2f-473d-ac0f-7e89eb52c0f7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081085 Sep 01 08:54:47.086428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2659/5343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:47 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:48.105451 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:48.106045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:48.111907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:48.112384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:48.112811 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:48.113477 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:48.113917 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:48.114375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:48.175024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:48.183577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6b358d40-4d07-47ed-aa03-9777bde3a753 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081946 Sep 01 08:54:48.184126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2685/5344] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:48 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:49.203923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:49.204596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:49.211404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:49.211877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:49.212300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:49.212965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:49.213406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:49.213817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:49.272601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:49.280036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2d9e2196-5276-4200-b663-c1378e842038 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080156 Sep 01 08:54:49.280588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2660/5345] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:49 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:50.300564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:50.301127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:50.308042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:50.308515 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:50.308938 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:50.309639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:50.310081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:50.310525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:50.372548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:50.380037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a9f51340-5909-4e81-96d6-05f1ba73666b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083505 Sep 01 08:54:50.380588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2686/5346] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:50 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:51.400998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:51.401515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:51.407421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:51.407903 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:51.408332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:51.409000 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:51.409447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:51.409861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:51.469220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:51.477184 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7b65e7f5-5039-4e97-b740-dd00334477f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080676 Sep 01 08:54:51.477922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2661/5347] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:51 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:52.497322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:52.497929 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:52.503783 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:52.504254 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:52.504679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:52.505351 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:52.505799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:52.506214 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:52.564922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:52.573138 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-23c77009-8708-4821-8ad3-79e8f216b28a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079618 Sep 01 08:54:52.573692 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2687/5348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:52 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:53.593443 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:53.594054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:53.602712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:53.603198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:53.603712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:53.604449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:53.604900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:53.605321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:53.674100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:53.683220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f779ccdc-7a99-46bc-9d9c-7c936bc21f91 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.093589 Sep 01 08:54:53.683789 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2662/5349] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:53 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:54.702670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:54.703299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:54.709263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:54.710301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:54.710725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:54.711396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:54.711837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:54.712251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:54.774097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:54.781672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb1021bc-d1cf-4947-99ba-97566e73514e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082766 Sep 01 08:54:54.782206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2688/5350] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:54 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:55.805310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:55.806460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:55.813396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:55.813876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:55.814331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:55.815025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:55.815471 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:55.815886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:56.022810 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:56.030520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-96b672b1-0127-4286-8aeb-e380d2465966 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.230808 Sep 01 08:54:56.031086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2663/5351] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:55 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:57.051441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:57.052053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:57.058950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:57.059415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:57.059849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:57.060535 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:57.060988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:57.061412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:57.119971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:57.127424 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-42e881c9-3f6c-4eea-a34a-3981bcced543 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079829 Sep 01 08:54:57.127978 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2689/5352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:57 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:58.147749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:58.148364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:58.154317 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:58.154797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:58.155229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:58.155904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:58.156352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:58.156775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:58.216069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:58.224594 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-273050d5-696e-4824-9d6f-9f190c5e3c42 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080934 Sep 01 08:54:58.225790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2664/5353] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:58 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:54:59.245381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:54:59.245986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:54:59.251924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:59.252397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:59.252830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:59.253504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:54:59.253951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:54:59.254514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:54:59.313292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:54:59.321659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-59bc0949-060c-45df-a43b-328c897daca7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080623 Sep 01 08:54:59.322213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2690/5354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:54:59 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:00.341981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:00.342610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:00.344437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:00.349819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:00.350338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:00.350915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:00.351602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:00.352051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:00.352469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:00.356502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:00.414448 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:00.421994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-baeb6d44-8eb1-47e4-b06b-872b3338e90c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083883 Sep 01 08:55:00.422585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2665/5355] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:00 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:01.443619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:01.444284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:01.446206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:01.451714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:01.452191 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:01.452616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:01.453294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:01.453770 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:01.454188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:01.456925 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:01.514224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:01.521695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0cdc08f6-8d54-47db-ac10-5fc3c7e699cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081935 Sep 01 08:55:01.522888 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2691/5356] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:01 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:02.543040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:02.543639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:02.549609 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:02.550083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:02.550538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:02.551209 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:02.551651 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:02.552063 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:02.610889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:02.619121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a43bee36-9ebc-4229-9c98-4848c711d243 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079862 Sep 01 08:55:02.619678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2666/5357] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:02 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:03.638922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:03.639525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:03.645389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:03.645859 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:03.646308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:03.646977 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:03.647519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:03.647935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:03.706478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:03.714009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e5024fa8-848c-4089-8001-c0a56d09d4df tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078901 Sep 01 08:55:03.714599 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2692/5358] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:03 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:04.734664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:04.735224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:04.741732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:04.742208 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:04.742660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:04.743332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:04.743773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:04.744188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:04.805944 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:04.813395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f051d8f3-10e7-4fc5-8d82-0a721acd5700 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082622 Sep 01 08:55:04.813955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2667/5359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:04 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:05.832801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:05.833384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:05.841270 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:05.841760 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:05.842188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:05.842889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:05.843330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:05.843800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:05.905427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:05.912846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0da2a3a2-4a83-4cd6-8e2c-5e95a8cb8352 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083843 Sep 01 08:55:05.913392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2693/5360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:05 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:06.933135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:06.933747 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:06.939610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:06.940080 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:06.940506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:06.941174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:06.941617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:06.942029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:07.000619 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:07.008577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-3b577fd7-a6a6-4330-801a-2e88d7ba9ba3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079270 Sep 01 08:55:07.009129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2668/5361] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:06 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:08.028941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:08.029548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:08.035440 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:08.035918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:08.036350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:08.037025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:08.038115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:08.038563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:08.097272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:08.104910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-935a89f4-9681-47f5-a006-ecc094fbb114 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079854 Sep 01 08:55:08.105465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2694/5362] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:08 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:09.125560 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:09.126151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:09.132159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:09.132639 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:09.133066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:09.133739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:09.134185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:09.134627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:09.199242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:09.207145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-147e4eca-7f99-4d40-84a4-06a324a46eca tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085414 Sep 01 08:55:09.207700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2669/5363] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:09 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:10.227474 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:10.228145 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:10.234028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:10.234537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:10.234974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:10.235652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:10.236100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:10.236522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:10.295001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:10.304130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ae6052a3-5388-4e9c-8dfe-2610a76633b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080580 Sep 01 08:55:10.304694 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2695/5364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:10 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:11.324886 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:11.325491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:11.331447 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:11.331923 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:11.332354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:11.333057 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:11.333503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:11.333922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:11.393060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:11.402583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-50da7383-c4bb-4229-ae57-b5439d1f7acd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081433 Sep 01 08:55:11.403546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2670/5365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:11 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:12.422930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:12.423550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:12.430232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:12.430726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:12.431150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:12.431817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:12.432257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:12.432669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:12.492282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:12.499784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-000691cd-419a-4332-a5a7-b18183a71da4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080621 Sep 01 08:55:12.500329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2696/5366] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:12 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:13.520194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:13.520830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:13.526955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:13.527432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:13.527863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:13.528537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:13.528984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:13.529402 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:13.590906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:13.598367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5a03e97d-8755-4e75-a250-98472f8124be tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081992 Sep 01 08:55:13.598928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2671/5367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:13 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:14.619059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:14.619687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:14.625615 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:14.626083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:14.626538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:14.627209 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:14.627651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:14.628065 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:14.687215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:14.695381 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-033e79e8-7e16-4756-8ae2-14ad791224fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080100 Sep 01 08:55:14.695932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2697/5368] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:14 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:15.715629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:15.716243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:15.722291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:15.722713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:15.723145 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:15.723818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:15.724267 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:15.725351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:15.783835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:15.791878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-acfc414d-0f58-4fd8-900a-182b423521ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080140 Sep 01 08:55:15.792428 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2672/5369] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:15 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:16.812391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:16.813002 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:16.818970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:16.819984 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:16.820417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:16.821099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:16.821552 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:16.821976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:16.880295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:16.888430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1dcd381a-0530-43ab-82e6-54882481286d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079942 Sep 01 08:55:16.888983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2698/5370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:16 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:17.909395 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:17.910005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:17.915890 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:17.916366 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:17.916791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:17.917456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:17.917899 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:17.918337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:17.979522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:17.986981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8e446731-f235-468a-b0b4-e735699aac86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081351 Sep 01 08:55:17.987528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2673/5371] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:17 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:19.008708 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:19.009322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:19.015586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:19.016120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:19.016654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:19.017367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:19.017815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:19.018235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:19.076920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:19.084318 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-de3fe7e1-3a85-41c2-be35-021751d9130d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080174 Sep 01 08:55:19.085608 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2699/5372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:19 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:20.105007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:20.105539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:20.111513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:20.111985 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:20.112414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:20.113087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:20.113532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:20.113948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:20.172849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:20.181216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-09c52a4d-b1a7-4637-a63e-56f892a2c537 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080322 Sep 01 08:55:20.181767 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2674/5373] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:20 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:21.200970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:21.201577 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:21.207462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:21.207941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:21.208379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:21.209057 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:21.209507 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:21.209933 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:21.268100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:21.275612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-494b69ba-2dba-47f5-be82-dbe8fd849792 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078523 Sep 01 08:55:21.276165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2700/5374] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:21 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:22.296362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:22.296964 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:22.303800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:22.304359 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:22.304797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:22.305476 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:22.305926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:22.306457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:22.370797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:22.378322 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7ebe537e-4a90-47eb-affe-6bfd4b7f3928 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085800 Sep 01 08:55:22.378877 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2675/5375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:22 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:23.399390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:23.400024 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:23.405790 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:23.406290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:23.406725 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:23.407396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:23.407873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:23.408291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:23.469973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:23.478250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5d147b04-26ea-4e08-8a5c-68e92624d175 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083404 Sep 01 08:55:23.478746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2701/5376] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:23 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:24.499435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:24.500190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:24.507584 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:24.508082 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:24.508691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:24.509780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:24.510235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:24.510736 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:24.573036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:24.580434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dbc98be0-820f-47d5-a97f-f795115daa6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085485 Sep 01 08:55:24.580987 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2676/5377] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:24 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:25.601581 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:25.602192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:25.608172 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:25.608657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:25.609088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:25.609821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:25.610364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:25.610797 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:25.671201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:25.680297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-dbaab633-140f-48b5-a143-be5ad9fbae56 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083157 Sep 01 08:55:25.680851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2702/5378] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:25 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:26.701025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:26.701552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:26.707718 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:26.708188 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:26.708610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:26.709273 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:26.709849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:26.710469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:26.773637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:26.784633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8ad6971e-7283-44ab-8b63-3e93a4798077 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.087327 Sep 01 08:55:26.785956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2677/5379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:26 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:27.805761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:27.806397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:27.812362 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:27.812841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:27.813293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:27.813970 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:27.814446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:27.814868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:27.873168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:27.880671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-946b9243-0bf5-45f0-8ff4-3b65c8804c34 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079606 Sep 01 08:55:27.881257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2703/5380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:27 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:28.902003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:28.902632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:28.908460 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:28.908936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:28.909362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:28.910031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:28.910506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:28.910917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:28.969508 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:28.977009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-826e2da4-23cb-4917-b530-ccbc4a5b5553 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078981 Sep 01 08:55:28.977769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2678/5381] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:28 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:29.997654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:29.998277 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:30.004052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:30.004525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:30.004954 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:30.005681 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:30.006194 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:30.007165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:30.066530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:30.074274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1c84cd0a-4d19-4c24-b81d-50a7e93f9c0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080570 Sep 01 08:55:30.074838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2704/5382] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:29 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:31.095782 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:31.096393 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:31.098220 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:31.103772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:31.104254 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:31.104700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:31.105373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:31.105823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:31.106239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:31.109014 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:31.174315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:31.182744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ddbf4cbd-df84-4040-8e04-97400ac2f5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.090716 Sep 01 08:55:31.183315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2679/5383] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:31 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:32.203569 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:32.204169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:32.206009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:32.211430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:32.211907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:32.212336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:32.213014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:32.213461 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:32.213879 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:32.216769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:32.273310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:32.280840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ff164ec0-ab8d-4fb2-9fa8-eacdbda7ce77 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081100 Sep 01 08:55:32.281391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2705/5384] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:32 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:33.300786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:33.301381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:33.308115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:33.308590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:33.309021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:33.309686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:33.310129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:33.310565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:33.369574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:33.377135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6744d0b1-0e70-492e-bdaf-09630b590051 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080124 Sep 01 08:55:33.377682 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2680/5385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:33 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:34.397224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:34.397907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:34.403800 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:34.404272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:34.404699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:34.405366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:34.405813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:34.406229 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:34.465061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:34.472636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5752276c-7549-40c7-8a1f-b5489f18c0c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079177 Sep 01 08:55:34.473193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2706/5386] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:34 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:35.493474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:35.494086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:35.500078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:35.500566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:35.501001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:35.501690 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:35.502203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:35.502580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:35.564293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:35.572693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d9f5e474-5555-41b4-aebf-2dab3e6bb278 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083768 Sep 01 08:55:35.573315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2681/5387] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:35 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:36.592866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:36.593475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:36.599418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:36.599902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:36.600425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:36.601643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:36.602102 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:36.602559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:36.660605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:36.668895 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-18d9adf2-b65e-45f9-8fe4-36cfc1473c3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079805 Sep 01 08:55:36.669462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2707/5388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:36 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:37.690055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:37.690687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:37.696764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:37.697245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:37.697686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:37.698389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:37.698841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:37.699262 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:37.758401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:37.766029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-262765cd-c23f-4104-80e6-2fb09f26f7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079772 Sep 01 08:55:37.766637 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2682/5389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:37 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:38.786447 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:38.787051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:38.793061 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:38.793529 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:38.793955 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:38.794670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:38.795114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:38.795526 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:38.853868 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:38.861332 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-11c1a0fe-7cd0-4bfb-95d9-ca38d251bf12 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078678 Sep 01 08:55:38.861890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2708/5390] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:38 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:39.882364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:39.882968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:39.888775 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:39.889248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:39.889674 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:39.890376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:39.890821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:39.891232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:39.952334 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:39.960071 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8f1a7d6c-359b-40bd-af85-6048daec51a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081583 Sep 01 08:55:39.960634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2683/5391] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:39 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:40.980866 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:40.981469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:40.987390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:40.987870 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:40.988299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:40.988976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:40.989423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:40.989840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:41.048455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:41.056222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-28bc940e-5db3-4aad-8ca8-3edd92dad829 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079154 Sep 01 08:55:41.056775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2709/5392] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:40 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:55:42.076490 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:42.077088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:42.082961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:42.083436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:42.083861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:42.084533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:42.084978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:42.085396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:42.144173 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:42.151645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ac40f738-f2a6-43db-8d9d-8fdd354c8a06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078983 Sep 01 08:55:42.152198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2684/5393] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:42 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:43.172436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:43.173041 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:43.179274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:43.179745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:43.180169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:43.180837 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:43.181281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:43.181695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:43.239586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:43.247059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f512389c-08cd-43ff-867b-2e1cded309b0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078470 Sep 01 08:55:43.247604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2710/5394] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:43 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:44.267175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:44.267760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:44.274472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:44.274945 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:44.275371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:44.276069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:44.276608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:44.277029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:44.338893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:44.346249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c42939b8-f3bf-4b87-9d95-ce65d7180417 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082823 Sep 01 08:55:44.346820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2685/5395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:44 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:45.366897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:45.367498 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:45.373417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:45.373898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:45.374360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:45.375034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:45.375481 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:45.375900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:45.434899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:45.442421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ab7cf6b-1518-4003-8ff8-707942890dc8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079462 Sep 01 08:55:45.442988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2711/5396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:45 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:46.463768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:46.464371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:46.470301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:46.470783 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:46.471214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:46.471888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:46.472330 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:46.472739 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:46.536024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:46.544295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6c1b7ae5-3bb4-48b4-8f24-c3b1181243a8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084838 Sep 01 08:55:46.544852 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2686/5397] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:46 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:47.564819 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:47.565534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:47.572246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:47.572786 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:47.573246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:47.573924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:47.574412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:47.574830 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:47.633630 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:47.641103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-093bd60a-d22a-4ac0-96d8-b6ce98d4d155 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080169 Sep 01 08:55:47.641654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2712/5398] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:47 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:48.662008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:48.662688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:48.668652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:48.669130 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:48.669559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:48.670232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:48.670704 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:48.671128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:48.732301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:48.739791 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-56178cab-c893-4ac0-a6b1-f521884cdc0d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081619 Sep 01 08:55:48.740362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2687/5399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:48 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:49.760936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:49.761462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:49.767398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:49.767872 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:49.768301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:49.768976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:49.769423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:49.769839 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:49.830927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:49.839109 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6bc506c3-805a-4f90-b3cc-4f8d19102773 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082654 Sep 01 08:55:49.839669 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2713/5400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:49 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:50.859242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:50.859835 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:50.865843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:50.866449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:50.866882 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:50.867552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:50.867995 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:50.868408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:50.927396 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:50.934909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-03766984-0712-4e72-b86c-702ffcef794c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079481 Sep 01 08:55:50.935456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2688/5401] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:50 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:55:51.955129 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:51.955730 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:51.962235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:51.962749 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:51.963178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:51.963853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:51.964302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:51.964721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:52.023902 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:52.031432 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b4c36e5-4f46-4eb5-bb5e-b50b597493f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080132 Sep 01 08:55:52.031983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2714/5402] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:51 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:53.051916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:53.052520 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:53.058896 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:53.059375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:53.059806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:53.060479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:53.060928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:53.061347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:53.230740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:53.238281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8d7f34be-d330-48ca-8b91-5bfede298653 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.190450 Sep 01 08:55:53.238836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2689/5403] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:53 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:54.259658 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:54.260269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:54.266106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:54.266613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:54.267045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:54.267719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:54.268168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:54.268588 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:54.387226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:54.394728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c06596ba-bb00-4164-8002-2213e35d2c76 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.139566 Sep 01 08:55:54.395278 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2715/5404] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:54 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:55.415732 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:55.416365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:55.422979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:55.423686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:55.424116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:55.424804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:55.425252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:55.425669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:55.500727 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:55.509353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1ae6073e-fabf-4755-a833-8096fbb541fa tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.098185 Sep 01 08:55:55.509931 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2690/5405] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:55 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:56.530976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:56.531578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:56.537385 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:56.537860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:56.538946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:56.539601 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:56.540045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:56.540463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:56.598716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:56.606709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-004d7c2a-66df-4bf3-9e61-a3155baeff4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079539 Sep 01 08:55:56.607264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2716/5406] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:56 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:57.627436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:57.628041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:57.634658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:57.635138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:57.635552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:57.636228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:57.636677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:57.637094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:57.699888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:57.708352 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1fbf238e-0fcc-496c-ba79-4f746d36ab7b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084795 Sep 01 08:55:57.708922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2691/5407] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:57 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:58.730804 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:58.731349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:58.737231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:58.737710 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:58.738150 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:58.738850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:58.739297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:58.739715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:58.798501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:58.806283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1925cb88-48b4-49f7-971b-d8e9105616c8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079298 Sep 01 08:55:58.806829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2717/5408] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:58 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:55:59.826247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:55:59.826876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:55:59.832897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:59.833406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:59.833840 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:59.834540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:55:59.835503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:55:59.835926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:55:59.895716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:55:59.903769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-25efdd2c-c56a-4c2b-a6b3-52d6e42d29f1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081306 Sep 01 08:55:59.904320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2692/5409] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:55:59 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:00.924337 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:00.924948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:00.932006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:00.932484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:00.932919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:00.933600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:00.934058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:00.934506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:00.993130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:01.000616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4aa86a7c-1e37-4214-8ce7-132168de0454 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080152 Sep 01 08:56:01.001171 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2718/5410] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:00 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:02.020323 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:02.020921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:02.023054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:02.028425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:02.028905 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:02.029363 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:02.030055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:02.030514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:02.030966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:02.034869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:02.094798 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:02.102198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-eb909d51-9d1b-4024-a0be-28ea1b1717d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085750 Sep 01 08:56:02.102770 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2693/5411] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:02 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:03.121948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:03.122582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:03.124934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:03.130158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:03.130670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:03.131103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:03.132306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:03.132761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:03.133181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:03.135914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:03.193706 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:03.202038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f2a51aa-b2f5-413e-bcee-5bcccaea47d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083947 Sep 01 08:56:03.202645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2719/5412] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:03 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:04.222306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:04.222921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:04.229003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:04.229482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:04.229918 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:04.230632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:04.231087 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:04.231511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:04.290586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:04.298045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-abf7cec1-e3bf-487f-bb6e-394b6cc8b19b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079684 Sep 01 08:56:04.298640 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2694/5413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:04 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:05.320009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:05.320715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:05.326657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:05.327164 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:05.327592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:05.328264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:05.328715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:05.329131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:05.387840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:05.395327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6ab877e8-6a1d-488c-96d5-dec7b7dca315 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079765 Sep 01 08:56:05.395876 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2720/5414] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:05 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:56:06.415537 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:06.416139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:06.421969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:06.422484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:06.422915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:06.423585 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:06.424027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:06.424441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:06.486967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:06.495370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d1594f21-c899-40a9-9adc-2b6a90ef30d9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083806 Sep 01 08:56:06.495962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2695/5415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:06 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:07.516989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:07.517380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:07.523086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:07.523563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:07.523997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:07.524673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:07.525126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:07.525548 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:07.584869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:07.592733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-22f08d23-e26b-4f47-9421-8b7b14f43318 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080005 Sep 01 08:56:07.593291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2721/5416] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:07 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:56:08.613676 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:08.614916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:08.621578 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:08.622050 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:08.622514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:08.623217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:08.623659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:08.624074 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:08.683176 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:08.690561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ecb02a36-bdbb-470e-9b8d-31942bae8251 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080671 Sep 01 08:56:08.691117 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2696/5417] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:08 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:09.711532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:09.712134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:09.718100 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:09.718613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:09.719046 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:09.719722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:09.720234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:09.720591 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:09.779998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:09.787437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-865e57bf-be0a-452b-8cf5-6839644d72ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080532 Sep 01 08:56:09.788037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2722/5418] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:09 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:10.808745 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:10.809382 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:10.815369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:10.815847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:10.816282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:10.816963 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:10.817408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:10.817828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:10.879048 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:10.886599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-093755bd-557a-48ee-b3ba-6b02d13569bc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081821 Sep 01 08:56:10.887153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2697/5419] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:10 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:11.907242 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:11.907854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:11.913918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:11.914441 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:11.914878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:11.915561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:11.916013 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:11.916438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:11.976388 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:11.984062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-71c377f9-5105-4d8f-ae27-827a3f20be45 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080660 Sep 01 08:56:11.984622 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2723/5420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:11 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:13.005203 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:13.005811 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:13.011897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:13.012387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:13.012804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:13.013482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:13.013929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:13.014375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:13.083033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:13.090946 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-49505c67-76d9-4f9c-baeb-0ac1e7f56ebd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.089638 Sep 01 08:56:13.091506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2698/5421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:13 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:14.111890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:14.112495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:14.118386 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:14.118871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:14.119307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:14.119985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:14.120436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:14.120853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:14.179574 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:14.187017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6cf81445-f5c4-4433-bfa2-a34354d7b084 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078965 Sep 01 08:56:14.187572 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2724/5422] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:14 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:15.207252 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:15.207857 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:15.213686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:15.214159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:15.214714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:15.215373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:15.215814 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:15.216230 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:15.277397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:15.285041 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4b330841-6d86-4644-9ac3-f5442cb16e3e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081624 Sep 01 08:56:15.285601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2699/5423] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:15 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:16.306112 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:16.306771 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:16.312625 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:16.313103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:16.313531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:16.314204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:16.314675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:16.315094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:16.373871 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:16.381373 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-85ae4097-7461-4288-af50-cd3153cd9d6d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079570 Sep 01 08:56:16.381927 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2725/5424] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:16 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:17.402691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:17.403292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:17.409194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:17.409671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:17.410098 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:17.410801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:17.411246 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:17.411659 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:17.471592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:17.479160 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cfa0f91e-1b75-44c0-a28a-8346d40eeecc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080289 Sep 01 08:56:17.479707 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2700/5425] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:17 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:18.499287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:18.499892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:18.505803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:18.506298 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:18.506732 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:18.507506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:18.507959 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:18.508402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:18.567178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:18.574750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-077ab3bc-11af-4356-9ab7-ddeb9329065b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079376 Sep 01 08:56:18.575302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2726/5426] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:18 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:19.595788 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:19.596399 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:19.602435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:19.602911 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:19.603346 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:19.604015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:19.604470 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:19.604887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:19.665617 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:19.673147 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-aa8fc089-0abc-47d3-8d15-f46eba9658d0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081169 Sep 01 08:56:19.673715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2701/5427] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:19 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:20.693066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:20.693655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:20.699912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:20.700383 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:20.700806 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:20.701473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:20.701914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:20.702360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:20.761852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:20.771990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f5f2ff8b-b15d-45af-9e52-b0a9780cad9a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082682 Sep 01 08:56:20.773320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2727/5428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:20 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:21.793823 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:21.794466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:21.800746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:21.801229 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:21.801665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:21.802431 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:21.802889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:21.803313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:21.862405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:21.870219 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-46727b18-0f6c-4713-9302-8a33b8911d82 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080395 Sep 01 08:56:21.870805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2702/5429] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:21 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:22.891018 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:22.891614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:22.897772 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:22.898460 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:22.898898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:22.899563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:22.900005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:22.900420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:22.962958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:22.970699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7c2c6994-4f86-4518-a4d0-0fc98cffd37e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083428 Sep 01 08:56:22.971249 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2728/5430] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:22 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:23.991295 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:23.991934 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:23.998467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:23.998942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:23.999371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:24.000035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:24.000477 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:24.000891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:24.062930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:24.070482 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-82fe03a8-a101-4028-8380-758680c29905 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082923 Sep 01 08:56:24.071043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2703/5431] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:23 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:56:25.091088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:25.091774 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:25.097495 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:25.097973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:25.098517 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:25.099197 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:25.099646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:25.100097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:25.159520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:25.167190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-17d01218-732a-42e9-9b2b-ea44b4c2575e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079939 Sep 01 08:56:25.167748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2729/5432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:25 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:26.188090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:26.188698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:26.194653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:26.195636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:26.196199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:26.196885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:26.197335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:26.197764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:26.256017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:26.264090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8c534f57-a412-4bdb-9e4b-b4fd391db643 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079865 Sep 01 08:56:26.264650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2704/5433] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:26 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:27.284995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:27.285626 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:27.292029 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:27.292510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:27.292939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:27.293614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:27.294060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:27.294504 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:27.353824 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:27.361215 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ffc566c1-1294-4a46-a2e3-6b09f42f338e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080029 Sep 01 08:56:27.361768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2730/5434] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:27 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:28.381301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:28.381904 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:28.388671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:28.389153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:28.389587 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:28.390270 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:28.390737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:28.391157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:28.454832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:28.462750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e98b32f2-e0f8-454f-89f4-8ae208119be4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085229 Sep 01 08:56:28.463329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2705/5435] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:28 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:29.483393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:29.484003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:29.489919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:29.490443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:29.490881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:29.491560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:29.492652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:29.493258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:29.552098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:29.560294 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a031ed39-e348-4823-a6a6-c5570be4a8ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080725 Sep 01 08:56:29.560844 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2731/5436] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:29 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:30.580687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:30.581293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:30.583291 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:56:30.583450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 (ip 10.222.0.43) !!! Sep 01 08:56:30.584442 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:56:30.584565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 (ip 10.222.0.43) !!! Sep 01 08:56:30.592414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:30.592897 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:30.593325 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:30.594003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:30.594488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:30.594912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:30.654837 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:30.662244 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-79446e8f-2838-49ac-8d03-b62cd7067d2d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085493 Sep 01 08:56:30.662831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2706/5437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:30 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:31.683190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:31.683880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:31.685709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:56:31.685854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 (ip 10.222.0.43) !!! Sep 01 08:56:31.691540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:31.692051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:31.692475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:31.693149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:31.693593 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:31.694008 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:31.754378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:31.761821 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-50b175cf-1ca1-466d-a576-8b1c1cfa60dd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083134 Sep 01 08:56:31.762389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2732/5438] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:31 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:32.783656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:32.784259 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:32.786171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:32.792135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:32.792603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:32.793038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:32.793691 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:32.794132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:32.794574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:32.798513 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:32.856336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:32.863867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7c0527bc-6243-412f-b228-5a02d14fc2f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084087 Sep 01 08:56:32.864416 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2707/5439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:32 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:33.884788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:33.885392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:33.887329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:33.892462 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:33.892936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:33.893363 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:33.894032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:33.894509 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:33.894926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:33.897538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:33.954864 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:33.963030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b79f5111-b839-4eb7-901d-a8082a5b4e0f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082717 Sep 01 08:56:33.963578 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2733/5440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:33 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:34.983347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:34.983949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:34.990023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:34.990532 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:34.990961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:34.991634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:34.992078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:34.992495 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:35.052288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:35.059773 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e4fd71d4-ff18-4d69-aec6-299d1335cc84 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080382 Sep 01 08:56:35.060321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2708/5441] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:34 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:36.080154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:36.080751 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:36.086719 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:36.087192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:36.087616 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:36.088283 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:36.088727 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:36.089142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:36.148035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:36.155878 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-acd5fdb6-cd62-459c-a738-4ca23f62c400 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079547 Sep 01 08:56:36.156442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2734/5442] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:36 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:37.178909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:37.179529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:37.185306 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:37.185781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:37.186204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:37.186894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:37.187337 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:37.187751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:37.248831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:37.256272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-236bcb25-f8cc-4fc1-b9d4-ed085a9fd7d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081597 Sep 01 08:56:37.256824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2709/5443] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:37 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:38.277301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:38.277904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:38.283957 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:38.284439 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:38.284867 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:38.285541 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:38.285992 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:38.286443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:38.345296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:38.353156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2922f981-3d45-4eeb-b5ea-7fec1f46a61e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080466 Sep 01 08:56:38.353705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2735/5444] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:38 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:39.372824 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:39.373418 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:39.379545 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:39.380019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:39.380445 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:39.381112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:39.381583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:39.381994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:39.441620 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:39.449200 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-133f1c09-840b-4a95-8805-7e9f639219eb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080212 Sep 01 08:56:39.449763 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2710/5445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:39 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:40.469050 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:40.469560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:40.475537 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:40.476638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:40.477104 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:40.477789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:40.478239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:40.478686 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:40.536687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:40.544546 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f19279ec-d5df-4772-bf94-3595b3f27f65 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079393 Sep 01 08:56:40.545093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2736/5446] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:40 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:41.566017 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:41.566669 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:41.573204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:41.573706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:41.574139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:41.574841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:41.575293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:41.575716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:41.637451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:41.644917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f361df29-2aa5-4dd5-bb8b-b8f6c637f102 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082817 Sep 01 08:56:41.645473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2711/5447] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:41 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:42.665052 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:42.665654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:42.672393 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:42.672849 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:42.673275 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:42.673943 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:42.674414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:42.675081 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:42.733650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:42.741076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4f3c0fde-e7d3-4106-826b-7c647f08e770 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079965 Sep 01 08:56:42.741857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2737/5448] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:42 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:43.762469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:43.763268 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:43.770866 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:43.771351 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:43.772141 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:43.772753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:43.773567 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:43.774369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:43.835042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:43.843126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad81f6d7-41aa-4c02-a863-02cef821bd6b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.086104 Sep 01 08:56:43.843681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2712/5449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:43 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:44.863969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:44.864575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:44.870675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:44.871154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:44.871583 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:44.872258 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:44.872707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:44.873124 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:44.932077 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:44.939524 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a0d8cbdf-e3a4-4cf5-859e-595d7706d098 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079396 Sep 01 08:56:44.940088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2738/5450] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:44 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:45.960649 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:45.961733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:45.967645 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:45.968122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:45.968551 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:45.969235 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:45.969681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:45.970102 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:46.031849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:46.039695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-48b02291-5609-46dc-bde0-1ccbe4baee8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083117 Sep 01 08:56:46.040253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2713/5451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:45 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:47.060308 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:47.060903 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:47.066711 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:47.067183 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:47.067607 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:47.068274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:47.068714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:47.069125 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:47.128635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:47.136246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9725a239-6a56-43f3-a308-94815846e968 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079755 Sep 01 08:56:47.136796 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2739/5452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:47 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:48.156872 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:48.157479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:48.163570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:48.164049 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:48.164478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:48.165151 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:48.165597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:48.166015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:48.225077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:48.232841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bb7c2784-f361-4c98-9aa9-fa57ee00e1d7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079833 Sep 01 08:56:48.233401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2714/5453] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:48 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:49.253310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:49.253939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:49.260565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:49.261040 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:49.261470 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:49.262149 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:49.262627 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:49.263043 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:49.321689 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:49.329379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-81e782da-5087-45c1-8ff8-d9e98f827b4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079908 Sep 01 08:56:49.329928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2740/5454] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:49 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:56:50.349231 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:50.349836 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:50.356419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:50.356891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:50.357320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:50.357984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:50.358458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:50.358875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:50.419784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:50.428024 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fa823349-b9a5-4466-8ca3-528ec16d64ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082641 Sep 01 08:56:50.428570 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2715/5455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:50 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:51.449379 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:51.449894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:51.455897 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:51.456377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:51.456809 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:51.457488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:51.457939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:51.458399 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:51.519799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:51.527687 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9c5fedc8-3794-4a2b-9293-307090a09805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082284 Sep 01 08:56:51.528248 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2741/5456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:51 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:52.548031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:52.548667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:52.555083 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:52.555539 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:52.555965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:52.556743 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:52.557186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:52.557600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:52.616529 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:52.623921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-80577758-e9ad-42be-9f11-29631f52adcd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079695 Sep 01 08:56:52.624478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2716/5457] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:52 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:53.644392 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:53.644998 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:53.650976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:53.651455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:53.651885 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:53.652562 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:53.653010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:53.653429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:53.711965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:53.719453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d1b3c0fb-7a78-4f37-9410-423645947634 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078885 Sep 01 08:56:53.720006 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2742/5458] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:53 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:54.739706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:54.740232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:54.746489 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:54.746969 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:54.747401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:54.748077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:54.748528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:54.748951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:54.810571 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:54.818089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a179048c-8e2e-49e1-b451-204ea3988bef tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082340 Sep 01 08:56:54.818698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2717/5459] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:54 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:55.839757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:55.840391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:55.846397 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:55.846881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:55.847312 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:55.847987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:55.848436 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:55.848863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:55.907506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:55.915201 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2f95f47b-a315-4421-8573-3c4bd0c45f6f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080099 Sep 01 08:56:55.915752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2743/5460] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:55 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:56.935472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:56.936078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:56.942018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:56.942526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:56.942958 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:56.943631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:56.944077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:56.945008 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:57.007830 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:57.017245 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d8f2fee7-aab6-4fdc-8c3e-9cd0b5d10a7a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085590 Sep 01 08:56:57.017805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2718/5461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:56 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:56:58.041224 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:58.041829 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:58.047713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:58.048189 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:58.048619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:58.049295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:58.049997 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:58.050449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:58.109487 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:58.117200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-fa5375b4-88e9-4e54-9457-1ad25de3da8e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080327 Sep 01 08:56:58.117759 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2744/5462] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:58 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:56:59.137528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:56:59.138128 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:56:59.143979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:59.144449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:59.144879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:59.145544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:56:59.145988 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:56:59.146504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:56:59.211885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:56:59.219480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-60d94ad9-e96b-4267-a280-2b752c4f5218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085773 Sep 01 08:56:59.220035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2719/5463] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:56:59 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:00.239958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:00.240544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:00.246540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:00.247023 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:00.247459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:00.248142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:00.248595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:00.249059 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:00.307911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:00.315449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f71d6675-01e3-4c4f-8bfc-ff249ef80c13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079329 Sep 01 08:57:00.316007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2745/5464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:00 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:01.336381 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:01.337013 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:01.343058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:01.343540 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:01.343980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:01.344642 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:01.345095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:01.345511 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:01.405485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:01.413040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7ff5fcf4-f4f6-4121-a98e-faf92dac15fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080541 Sep 01 08:57:01.413601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2720/5465] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:01 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:02.433538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:02.434127 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:02.440272 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:02.440758 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:02.441196 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:02.441880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:02.442353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:02.442777 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:02.501662 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:02.509185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7cf7b22f-a352-4b32-ae8c-dbc247a03c9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079532 Sep 01 08:57:02.509741 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2746/5466] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:02 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:03.529194 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:03.529797 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:03.531629 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:03.537118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:03.537589 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:03.538663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:03.539378 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:03.539818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:03.540234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:03.542885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:03.602698 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:03.610170 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8b0a4172-ad65-46c2-a1b2-60e4a246ba4a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084764 Sep 01 08:57:03.610752 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2721/5467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:03 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:04.630456 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:04.631063 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:04.633087 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:04.638180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:04.638690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:04.639123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:04.639801 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:04.640250 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:04.640671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:04.644672 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:04.700932 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:04.708417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2e0d6129-1ece-4d8b-84c5-11e520e41478 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081816 Sep 01 08:57:04.708974 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2747/5468] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:04 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:05.730233 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:05.730771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:05.737060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:05.737534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:05.737960 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:05.738663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:05.739112 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:05.739524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:05.797777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:05.806132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1bd9e9a-6b58-4853-86fd-8ebaf7f702f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080019 Sep 01 08:57:05.806706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2722/5469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:05 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:57:06.826478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:06.827066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:06.832912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:06.833389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:06.833814 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:06.835501 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:06.836155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:06.836155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:06.896565 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:06.905004 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5e56e4d7-7366-4aa4-8fb9-f2f08eb2d063 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082425 Sep 01 08:57:06.905559 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2748/5470] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:06 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:07.925878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:07.926509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:07.932548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:07.933022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:07.933450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:07.934115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:07.934590 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:07.935012 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:07.995926 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:08.003454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-cf034bc2-eba7-49e2-ab18-f28f2e2ca29d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081625 Sep 01 08:57:08.004009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2723/5471] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:07 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:09.023635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:09.024889 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:09.030856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:09.031327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:09.031753 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:09.032463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:09.032906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:09.033320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:09.092257 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:09.099769 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c344ecd8-366e-4556-85aa-393214710cc1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080060 Sep 01 08:57:09.100416 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2749/5472] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:09 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:10.120432 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:10.121094 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:10.126906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:10.127380 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:10.127805 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:10.128472 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:10.128913 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:10.129329 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:10.189086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:10.196496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2361780b-fa41-4ce1-9fa3-79d799a08d21 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079989 Sep 01 08:57:10.197045 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2724/5473] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:10 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:11.216679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:11.217285 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:11.223219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:11.223693 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:11.224123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:11.224799 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:11.225425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:11.225848 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:11.284636 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:11.292401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-7e3772b5-a80b-4926-aec0-9c0a14dc8e48 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079507 Sep 01 08:57:11.292946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2750/5474] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:11 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:12.312936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:12.313547 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:12.319613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:12.320096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:12.320531 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:12.321216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:12.321668 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:12.322089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:12.384206 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:12.391786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e6315b65-d1fb-4783-8955-494a816657d1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082700 Sep 01 08:57:12.392344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2725/5475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:12 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:13.412445 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:13.413076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:13.418948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:13.419450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:13.419875 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:13.420547 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:13.420990 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:13.421406 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:13.482180 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:13.489816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-481c7c92-6152-42c9-a0d8-5cae8e13b936 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081285 Sep 01 08:57:13.490395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2751/5476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:13 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:14.511214 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:14.511818 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:14.517673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:14.518155 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:14.518630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:14.519308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:14.519756 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:14.520175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:14.579138 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:14.587234 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9c43c408-82df-4a61-af1f-f86429da8295 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079933 Sep 01 08:57:14.587790 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2726/5477] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:14 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:15.607344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:15.607988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:15.613967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:15.614525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:15.614966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:15.616157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:15.616611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:15.617035 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:15.675544 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:15.683690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4f257692-34d9-4ee3-8393-89daadd441bd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080233 Sep 01 08:57:15.684241 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2752/5478] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:15 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:16.704898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:16.705506 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:16.712135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:16.712614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:16.713060 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:16.713733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:16.714210 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:16.714724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:16.775665 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:16.783281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9afbd290-ee4b-4487-889a-faa6d79b0dea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082251 Sep 01 08:57:16.783843 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2727/5479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:16 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:17.804709 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:17.805353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:17.811402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:17.811882 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:17.812315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:17.812987 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:17.813433 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:17.813851 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:17.872400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:17.879941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-3e51f174-f06f-496b-aee1-c81003d4cde5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079971 Sep 01 08:57:17.880490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2753/5480] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:17 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:18.901576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:18.902174 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:18.908015 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:18.908485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:18.908917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:18.909583 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:18.910025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:18.910473 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:18.969367 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:18.976888 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-018a6f8c-9a25-434c-91f5-552842b5d532 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079170 Sep 01 08:57:18.977435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2728/5481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:18 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:19.996926 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:19.997530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:20.003444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:20.003920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:20.004355 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:20.005028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:20.005476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:20.005900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:20.065322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:20.073414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-471be9a3-51c7-4b0d-b277-ad853a62fa20 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080325 Sep 01 08:57:20.073967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2754/5482] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:19 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:21.092928 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:21.093516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:21.099484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:21.100566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:21.101011 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:21.101667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:21.102110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:21.102561 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:21.164953 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:21.172553 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-578b9663-34e2-4c65-805d-9770b9674ddf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083521 Sep 01 08:57:21.173115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2729/5483] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:21 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:22.192841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:22.193482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:22.199374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:22.199845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:22.200271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:22.200950 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:22.201396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:22.201812 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:22.260082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:22.267473 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-044b5ee0-a388-4a6c-b047-e86c0c67e23e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078417 Sep 01 08:57:22.268032 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2755/5484] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:22 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:23.287740 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:23.288342 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:23.295272 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:23.295751 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:23.296182 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:23.296861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:23.297311 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:23.297730 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:23.356441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:23.363864 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-d9b1686e-e459-4421-84cb-7dac87a0228a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079906 Sep 01 08:57:23.364424 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2730/5485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:23 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:24.385678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:24.386327 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:24.392178 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:24.392648 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:24.393075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:24.393743 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:24.394188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:24.394701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:24.453604 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:24.461478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-1589c8c4-383a-4667-8cf6-7e43000cdcfb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080383 Sep 01 08:57:24.462031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2756/5486] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:24 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:25.480900 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:25.481512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:25.487827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:25.488338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:25.488772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:25.489461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:25.489914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:25.490360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:25.554305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:25.562650 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f4c49f66-223b-45d1-8da1-ca35028bf50f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085509 Sep 01 08:57:25.563360 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2731/5487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:25 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:26.583525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:26.585069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:26.591009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:26.591484 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:26.591916 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:26.592589 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:26.593037 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:26.593457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:26.652512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:26.659923 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ee51627d-80a6-4772-9558-a68b48fc805c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080239 Sep 01 08:57:26.660471 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2757/5488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:26 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:27.681055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:27.681660 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:27.687658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:27.688135 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:27.688566 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:27.689237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:27.689684 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:27.690122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:27.749332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:27.757388 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-087fc31f-dc8e-4bab-b509-20265c95df06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080638 Sep 01 08:57:27.757967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2732/5489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:27 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:28.776832 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:28.777360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:28.783367 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:28.783842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:28.784273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:28.784948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:28.785398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:28.785817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:28.853685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:28.861168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b784d1c2-3502-47c1-a5ce-98aec944ab46 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.088205 Sep 01 08:57:28.861726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2758/5490] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:28 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:29.881559 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:29.882217 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:29.888040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:29.888509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:29.888932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:29.889596 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:29.890038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:29.890492 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:29.952742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:29.960528 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c4a0886c-bcc3-4f54-86e1-edbeaadd4919 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083439 Sep 01 08:57:29.961088 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2733/5491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:29 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:30.980717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:30.981330 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:30.987268 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:30.987747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:30.988177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:30.988853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:30.989301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:30.989723 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:31.049654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:31.057928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-124dabb4-b3bd-4676-8a8d-66d83a318019 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081073 Sep 01 08:57:31.058516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2759/5492] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:30 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:32.077833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:32.078467 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:32.084440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:32.084917 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:32.085350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:32.086021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:32.086514 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:32.086935 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:32.145480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:32.153104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-737ca36c-3b47-48e2-939e-83552dc95572 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079069 Sep 01 08:57:32.153661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2734/5493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:32 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:33.173377 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:33.174244 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:33.180410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:33.180892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:33.181319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:33.182000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:33.182469 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:33.182891 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:33.241638 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:33.249054 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a165d85a-9ac4-4349-8766-fa0304bd134c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079703 Sep 01 08:57:33.249614 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2760/5494] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:33 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:34.270284 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:34.270881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:34.272792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:34.277894 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:34.278390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:34.278821 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:34.279504 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:34.279951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:34.280371 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:34.283070 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:34.342633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:34.350120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-24e047f0-64a4-4145-9ba8-dd7f8b6f68f4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083657 Sep 01 08:57:34.350741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2735/5495] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:34 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:35.371062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:35.371670 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:35.373525 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:35.378822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:35.379300 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:35.379728 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:35.380412 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:35.380991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:35.381413 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:35.384152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:57:35.442239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:35.450458 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-64ac1289-7a43-4d8a-9805-13def362b1ac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083288 Sep 01 08:57:35.451203 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2761/5496] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:35 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:57:36.470966 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:36.471643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:36.477849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:36.478350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:36.478786 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:36.479462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:36.479907 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:36.480355 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:36.539598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:36.547122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-255150d1-f4be-44e7-beff-7c2e6655ec6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079950 Sep 01 08:57:36.547677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2736/5497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:36 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:37.568372 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:37.569228 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:37.575167 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:37.575646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:37.576079 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:37.576880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:37.577329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:37.577752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:37.639009 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:37.647158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f1bd665c-2d9c-44ef-839a-4e99e078d6d3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083102 Sep 01 08:57:37.647717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2762/5498] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:37 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:38.667940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:38.668536 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:38.674771 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:38.675243 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:38.675667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:38.676335 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:38.676776 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:38.677750 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:38.737932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:38.746127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-144547ba-ee6a-4efc-89fa-a17a0a7f1e19 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082113 Sep 01 08:57:38.746715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2737/5499] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:38 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:39.767286 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:39.767817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:39.773971 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:39.774490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:39.774922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:39.775592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:39.776034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:39.776450 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:39.835089 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:39.842508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-10030372-c248-47fa-ab76-1d1b753352d5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079094 Sep 01 08:57:39.843060 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2763/5500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:39 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:40.863648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:40.864257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:40.870827 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:40.871304 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:40.871737 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:40.872414 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:40.872860 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:40.873280 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:40.932420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:40.939878 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-34bcf88c-2b19-4101-a294-501b1c41ac9c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080015 Sep 01 08:57:40.940435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2738/5501] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:40 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:41.960721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:41.961252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:41.967152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:41.967632 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:41.968064 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:41.968737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:41.969188 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:41.969606 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:42.028056 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:42.035520 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4610a906-c149-459e-a92e-7bf15feca031 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078686 Sep 01 08:57:42.036072 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2764/5502] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:41 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:43.056802 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:43.057406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:43.063308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:43.063777 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:43.064202 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:43.064869 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:43.065313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:43.065729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:43.126716 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:43.134803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4dada7b2-0200-445c-a85b-9edd59286cb9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081791 Sep 01 08:57:43.135350 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2739/5503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:43 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:44.154920 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:44.155527 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:44.162595 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:44.163152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:44.163592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:44.164281 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:44.164733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:44.165156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:44.226881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:44.234479 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-84b27bc1-5014-404b-84ce-e1869a6747e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083305 Sep 01 08:57:44.235031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2765/5504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:44 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:45.254820 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:45.255463 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:45.261255 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:45.261728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:45.262154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:45.262847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:45.263292 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:45.263708 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:45.323055 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:45.330488 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2494a5c8-8621-4664-98c3-5029e093e58a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079490 Sep 01 08:57:45.331042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2740/5505] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:45 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:46.351483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:46.352111 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:46.357907 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:46.358401 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:46.358822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:46.359486 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:46.359924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:46.360336 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:46.420177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:46.428532 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e4596e4-82aa-45a3-84c0-9f93c78701dc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081090 Sep 01 08:57:46.429085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2766/5506] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:46 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:47.448812 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:47.449441 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:47.455336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:47.455871 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:47.456301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:47.457029 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:47.457474 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:47.457893 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:47.518982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:47.526826 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f3bafa7a-7976-4ad9-aa8c-5bd15f0c9522 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081823 Sep 01 08:57:47.527383 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2741/5507] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:47 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:48.547575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:48.548182 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:48.555187 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:48.555664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:48.556119 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:48.556822 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:48.557255 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:48.557699 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:48.617333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:48.625001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4e24936d-ab4b-470b-b477-658e7ef986c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081225 Sep 01 08:57:48.625564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2767/5508] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:48 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:49.645179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:49.646459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:49.652600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:49.653072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:49.653503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:49.654175 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:49.654644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:49.655058 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:49.714354 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:49.721909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1b5de7c-9c47-4a10-a03c-3d940f5214b3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080469 Sep 01 08:57:49.722434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2742/5509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:49 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:50.741825 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:50.742366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:50.748560 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:50.749031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:50.749453 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:50.750120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:50.750600 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:50.751014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:50.816048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:50.823650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-cd5e5f5c-fab2-498d-b267-7e941a50dc78 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085727 Sep 01 08:57:50.824204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2768/5510] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:50 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:51.844370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:51.844965 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:51.851794 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:51.852265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:51.852687 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:51.853358 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:51.853800 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:51.854227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:51.915046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:51.922485 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-2ab01488-eb83-4904-8b49-d5933572634a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081933 Sep 01 08:57:51.923030 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2743/5511] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:51 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:52.942675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:52.943446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:52.949306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:52.949787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:52.950218 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:52.950924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:52.951368 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:52.951788 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:53.010410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:53.018233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d3a4accf-5060-4619-a822-a46b3052dc83 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079412 Sep 01 08:57:53.018818 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2769/5512] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:52 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:54.040420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:54.041016 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:54.046916 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:54.047390 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:54.047817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:54.048748 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:54.049189 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:54.049603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:54.108438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:54.116634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0fe00c14-ea1c-40f1-a6fd-702a9b20ae31 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080779 Sep 01 08:57:54.117190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2744/5513] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:54 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:55.137090 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:55.137679 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:55.143518 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:55.143991 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:55.144419 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:55.145085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:55.145668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:55.146110 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:55.204310 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:55.211896 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-426c2f9a-d9c7-4faa-a571-0de1cb488941 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078637 Sep 01 08:57:55.212452 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2770/5514] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:55 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:56.232097 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:56.232731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:56.238641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:56.239115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:56.239574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:56.240241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:56.240713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:56.241126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:56.309282 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:56.318343 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-5557db02-0675-4a48-b8be-6df3b4c39887 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.089248 Sep 01 08:57:56.319035 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2745/5515] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:56 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:57.339490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:57.340120 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:57.345966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:57.346478 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:57.346911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:57.347576 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:57.348031 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:57.348490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:57.407091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:57.414703 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-223e20b6-6674-4002-953a-4c329ef4dd11 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079016 Sep 01 08:57:57.415256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2771/5516] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:57 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:58.435832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:58.436438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:58.443116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:58.443600 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:58.444032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:58.444721 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:58.445168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:58.445586 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:58.505264 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:58.512764 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-93a33eb5-6355-4c1b-98d6-cd7f2b9113fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080734 Sep 01 08:57:58.513318 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2746/5517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:58 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:57:59.533496 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:57:59.534097 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:57:59.540666 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:59.541134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:59.541558 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:59.542221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:57:59.542685 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:57:59.543099 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:57:59.601983 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:57:59.609438 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-580375c9-20b2-47ac-b69a-ba9d00057bac tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079791 Sep 01 08:57:59.609989 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2772/5518] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:57:59 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:00.629228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:00.630434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:00.636512 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:00.636990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:00.637453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:00.638127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:00.638606 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:00.639027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:00.703361 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:00.711109 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4db05540-1170-4ac3-ad8a-494f2df02a98 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.085693 Sep 01 08:58:00.711671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2747/5519] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:00 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:01.731704 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:01.732221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:01.738159 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:01.738660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:01.739904 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:01.740585 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:01.741030 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:01.741446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:01.799635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:01.807869 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8698399e-6c60-4885-ad22-609ba8dbbd4b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080075 Sep 01 08:58:01.808425 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2773/5520] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:01 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:02.827768 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:02.828372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:02.834499 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:02.834979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:02.835407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:02.836081 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:02.836524 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:02.836942 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:02.895341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:02.902957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0a82337d-9dea-42d1-af78-226f95dbf5c4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079062 Sep 01 08:58:02.903517 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2748/5521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:02 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:03.922353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:03.923219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:03.929698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:03.930173 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:03.930635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:03.931313 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:03.931761 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:03.932179 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:03.990142 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:03.997660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f2443fb9-34f0-40c9-96e4-19ddde9a744f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079188 Sep 01 08:58:03.998216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2774/5522] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:03 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:05.018413 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:05.019021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:05.020838 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:05.025921 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:05.026457 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:05.026889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:05.027592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:05.028040 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:05.028461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:05.031192 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:05.090778 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:05.098301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8dd26235-c4cb-44e1-aa3b-0b6e78811450 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083757 Sep 01 08:58:05.098850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2749/5523] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:05 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:06.118611 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:06.119204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:06.121007 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:06.126714 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:06.127267 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:06.127676 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:06.128350 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:06.128794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:06.129207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:06.131972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:06.191287 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:06.199095 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-be94352d-8ced-4b6b-95a9-1e772c5041c3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084276 Sep 01 08:58:06.199661 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2775/5524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:06 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:07.219533 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:07.220089 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:07.226662 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:07.227144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:07.227604 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:07.228285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:07.228735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:07.229159 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:07.287315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:07.294806 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6d37bb1e-c973-4ddc-aea0-c88ecc4a95e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079164 Sep 01 08:58:07.295368 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2750/5525] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:07 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:08.314701 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:08.315295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:08.321237 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:08.321715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:08.322146 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:08.322847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:08.323295 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:08.323713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:08.381899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:08.389423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f59b63d-49bd-48da-b2a6-7920d626dfd6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078592 Sep 01 08:58:08.389973 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2776/5526] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:08 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:09.408884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:09.409481 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:09.416126 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:09.416615 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:09.417038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:09.417714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:09.418161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:09.418681 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:09.480573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:09.488115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b1fdfbfc-a7cf-42c0-a3d7-6f42797a93a7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083094 Sep 01 08:58:09.488675 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2751/5527] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:09 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:10.508246 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:10.508853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:10.514817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:10.515292 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:10.515724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:10.516398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:10.516846 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:10.517264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:10.575490 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:10.582936 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9dbde7cf-3d35-473e-ae70-63685f13730d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079093 Sep 01 08:58:10.584282 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2777/5528] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:10 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:11.604221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:11.604861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:11.611613 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:11.612096 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:11.612534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:11.613216 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:11.613667 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:11.614090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:11.672331 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:11.680842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9df6df60-f2e0-4a13-8e37-e70b2491693c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080382 Sep 01 08:58:11.681394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2752/5529] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:11 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:12.700881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:12.701508 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:12.707765 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:12.708243 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:12.708673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:12.710062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:12.710540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:12.710962 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:12.768075 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:12.776185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-b0432a72-079c-477f-bdcb-41d73786616a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079165 Sep 01 08:58:12.776746 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2778/5530] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:12 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:13.796434 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:13.797042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:13.803398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:13.803876 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:13.804312 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:13.804991 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:13.805438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:13.805859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:13.866909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:13.874478 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-9bea92cf-2027-4c70-8a1c-368a8a3be7ee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081879 Sep 01 08:58:13.875032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2753/5531] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:13 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:14.894184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:14.894836 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:14.900862 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:14.901335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:14.901762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:14.902465 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:14.902914 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:14.903338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:14.964048 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:14.971602 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-39c58d9f-e55e-4db8-8ebd-caefd1ac6a86 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081317 Sep 01 08:58:14.972168 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2779/5532] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:14 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:15.992028 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:15.992636 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:15.998574 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:15.999051 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:15.999484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:16.000162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:16.000611 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:16.001033 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:16.061491 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:16.069713 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0d6e34fe-6212-4b2c-be4c-926a55e62c2f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080731 Sep 01 08:58:16.070288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2754/5533] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:15 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:17.090423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:17.090966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:17.096784 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:17.097263 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:17.097695 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:17.098402 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:17.098852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:17.099271 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:17.157995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:17.166192 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-129160f8-9cc6-43be-92f9-f1b61bf1ea66 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079677 Sep 01 08:58:17.166775 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2780/5534] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:17 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:18.186710 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:18.187310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:18.193345 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:18.194344 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:18.194772 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:18.195439 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:18.195887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:18.196300 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:18.257405 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:18.264891 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7fd31836-08ea-47d0-b9f5-4cad5a81c70d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081969 Sep 01 08:58:18.265444 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2755/5535] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:18 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:58:19.285922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:19.286637 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:19.293088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:19.293564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:19.293996 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:19.294700 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:19.295153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:19.295571 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:19.354126 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:19.361575 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-221909f8-db04-4df8-9dac-ed8e99a34765 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079654 Sep 01 08:58:19.362130 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2781/5536] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:19 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:20.381658 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:20.382278 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:20.388404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:20.388879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:20.389308 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:20.389980 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:20.390453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:20.390867 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:20.450090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:20.457647 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-129547fb-74cd-40c4-80f3-72e4504b628d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079896 Sep 01 08:58:20.458198 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2756/5537] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:20 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:21.476877 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:21.477476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:21.483324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:21.483795 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:21.484219 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:21.484892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:21.485335 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:21.485748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:21.543816 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:21.551472 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-faa1bb71-a796-4567-8bd2-813329c736a2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078461 Sep 01 08:58:21.552019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2782/5538] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:21 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:22.572438 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:22.573038 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:22.578993 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:22.579454 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:22.579881 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:22.580601 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:22.581046 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:22.581458 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:22.641854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:22.650185 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-13c617dd-3202-47aa-bd9e-8f69058c84f9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082073 Sep 01 08:58:22.650769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2757/5539] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:22 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:23.670317 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:23.670924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:23.677193 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:23.677716 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:23.678206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:23.678911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:23.679364 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:23.679787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:23.737968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:23.745668 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-db54aaf0-e570-43f9-889e-f7a1932c0d28 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079151 Sep 01 08:58:23.746223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2783/5540] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:23 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:24.765912 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:24.766516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:24.772375 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:24.772841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:24.773266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:24.773932 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:24.774398 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:24.774828 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:24.833239 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:24.840865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-737b59d2-179f-41e4-818c-7445446573c0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078862 Sep 01 08:58:24.841408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2758/5541] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:24 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:25.860850 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:25.861449 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:25.867418 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:25.867892 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:25.868322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:25.868993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:25.869437 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:25.869852 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:25.929239 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:25.936762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-38a602b9-441b-499f-b1cf-318fbc4f6b6a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079731 Sep 01 08:58:25.937307 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2784/5542] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:25 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:26.956873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:26.957522 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:26.963285 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:26.963758 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:26.964186 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:26.964854 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:26.965298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:26.965711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:27.026483 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:27.034022 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a3dee70a-1e24-4884-85dd-09b64b0800f2 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080923 Sep 01 08:58:27.034603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2759/5543] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:26 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:28.055338 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:28.055945 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:28.061823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:28.062333 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:28.062768 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:28.063444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:28.063894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:28.064311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:28.122563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:28.130027 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ea33d3cc-acd1-43c8-b621-07e4729c86c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078690 Sep 01 08:58:28.130612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2785/5544] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:28 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:29.150769 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:29.151408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:29.157253 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:29.157731 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:29.158161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:29.158863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:29.159315 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:29.159735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:29.218332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:29.225792 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b3d24143-703c-41c4-a301-638d8d69d7da tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078913 Sep 01 08:58:29.226909 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2760/5545] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:29 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:30.247045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:30.247646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:30.253430 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:30.253910 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:30.254380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:30.255062 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:30.255512 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:30.255930 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:30.314659 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:30.322435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d811da63-0672-4f94-a46a-e5411c6f4f23 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079145 Sep 01 08:58:30.322999 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2786/5546] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:30 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:58:31.342569 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:31.343167 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:31.348982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:31.349456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:31.349883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:31.350576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:31.351023 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:31.351435 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:31.414146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:31.422962 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-7f227c65-95a1-4992-bccc-6898f538195c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084321 Sep 01 08:58:31.423955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2761/5547] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:31 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:32.445053 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:32.445705 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:32.452152 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:32.452635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:32.453284 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:32.453966 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:32.454443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:32.454858 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:32.514980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:32.522240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-924adcb0-c4a7-4e7a-9d6c-645790b6f27b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081180 Sep 01 08:58:32.523356 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2787/5548] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:32 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:33.543373 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:33.543972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:33.550161 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:33.550661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:33.551086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:33.551753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:33.552193 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:33.552608 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:33.610874 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:33.619121 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-29a62039-0a48-4f5e-94a3-aca09772d5fb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079545 Sep 01 08:58:33.619677 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2762/5549] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:33 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:34.639068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:34.639671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:34.645890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:34.646444 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:34.646906 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:34.647617 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:34.648073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:34.648516 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:34.707536 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:34.715231 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-43167166-fb26-4e7f-9406-62731bade340 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079989 Sep 01 08:58:34.715794 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2788/5550] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:34 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:35.736036 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:35.736565 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:35.738397 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:35.744332 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:35.744801 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:35.745224 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:35.745887 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:35.746357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:35.746774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:35.749336 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:35.808437 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:35.815954 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6e6b9e43-f377-4911-9645-5f74d61f841a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083864 Sep 01 08:58:35.816503 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2763/5551] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:35 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:36.837922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:36.838597 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:36.840459 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:36.845738 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:36.846221 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:36.846678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:36.847396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:36.847845 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:36.848265 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:36.852564 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:36.914951 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:36.922690 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-579cd7b7-11da-4a91-bde7-11daff5175f3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.089055 Sep 01 08:58:36.923240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2789/5552] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:36 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:37.943084 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:37.943693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:37.949632 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:37.950110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:37.950573 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:37.951249 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:37.951695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:37.952113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:38.011817 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:38.019213 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-47d92873-a603-433c-abab-1eb88e473a9d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079903 Sep 01 08:58:38.019779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2764/5553] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:37 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:39.040098 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:39.040739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:39.046647 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:39.047384 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:39.047815 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:39.048488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:39.048939 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:39.049359 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:39.108003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:39.115375 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0b3a5612-fcad-40f6-aa86-6c1dba9b98f8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079625 Sep 01 08:58:39.115931 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2790/5554] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:39 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:40.136858 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:40.137403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:40.143241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:40.143711 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:40.144139 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:40.144804 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:40.145248 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:40.145663 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:40.206654 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:40.214021 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-406e6a05-def0-4385-8786-d4b400c08439 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081077 Sep 01 08:58:40.214599 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2765/5555] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:40 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:41.234204 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:41.234840 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:41.241051 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:41.241678 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:41.242122 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:41.242841 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:41.243290 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:41.243712 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:41.302344 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:41.309922 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c0f9032f-fa4e-4319-9d88-86cfb78b72cf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079651 Sep 01 08:58:41.310506 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2791/5556] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:41 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:42.330715 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:42.331347 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:42.337678 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:42.338152 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:42.338597 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:42.339274 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:42.339749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:42.340162 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:42.398746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:42.406090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0137e7c7-71db-4399-87f4-604f757382fc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079190 Sep 01 08:58:42.406680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2766/5557] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:42 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:43.471791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:43.472302 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:43.478114 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:43.478619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:43.479049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:43.479721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:43.480169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:43.480586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:43.539049 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:43.546642 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5b6ff2c7-fa00-4660-9f88-3d9fa678a316 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.123202 Sep 01 08:58:43.547466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2792/5558] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:43 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:44.568760 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:44.569411 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:44.575404 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:44.575885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:44.576319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:44.577003 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:44.577461 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:44.577879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:44.638930 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:44.646372 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-476f258b-a67b-42bc-9677-4d51536ca763 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081400 Sep 01 08:58:44.646937 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2767/5559] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:44 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:45.667457 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:45.668058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:45.674334 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:45.674807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:45.675235 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:45.675900 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:45.676340 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:45.676750 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:45.735514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:45.743550 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6e0927ee-3c5a-4f05-97ba-af24f4fb95ad tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080338 Sep 01 08:58:45.744113 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2793/5560] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:45 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:46.764110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:46.764644 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:46.770456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:46.770929 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:46.771357 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:46.772025 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:46.772462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:46.772875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:46.831868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:46.839484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-dea578eb-47ee-4885-a441-ee766084315c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079390 Sep 01 08:58:46.840042 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2768/5561] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:46 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:47.859324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:47.859921 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:47.865791 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:47.866976 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:47.867361 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:47.868026 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:47.868468 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:47.868881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:47.927376 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:47.935380 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-f38a512f-1ec4-4641-b0f2-fbe2313c0bb4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079825 Sep 01 08:58:47.935934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2794/5562] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:47 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:48.955487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:48.956090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:48.962575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:48.963052 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:48.963480 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:48.964148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:48.964592 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:48.965009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:49.026120 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:49.034137 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-a0f84103-22c5-459f-9a4c-25c9bde7af9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082426 Sep 01 08:58:49.034729 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2769/5563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:48 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:50.055360 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:50.056005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:50.062017 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:50.062530 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:50.062969 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:50.063655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:50.064115 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:50.064540 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:50.123091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:50.130603 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4df90c6b-78e0-477e-b4fd-545d50e9210c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079308 Sep 01 08:58:50.131158 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2795/5564] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:50 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:51.151614 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:51.152196 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:51.158392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:51.158873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:51.159296 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:51.159984 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:51.160425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:51.160961 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:51.221320 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:51.230144 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b8c6918f-6b06-4e9e-8e4d-d8fdbf28971f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082561 Sep 01 08:58:51.230735 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2770/5565] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:51 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:52.251370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:52.251967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:52.258226 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:52.258733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:52.259153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:52.259823 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:52.260485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:52.260908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:52.320067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:52.328343 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9330653e-623b-4ec8-bacb-8a49b83bba07 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080774 Sep 01 08:58:52.328899 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2796/5566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:52 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:53.348883 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:53.349484 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:53.356077 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:53.356552 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:53.356978 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:53.357653 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:53.358129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:53.358575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:53.560724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:53.568588 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ef6f2e8e-01c5-453f-bf02-17d7952183f6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.223347 Sep 01 08:58:53.569187 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2771/5567] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:53 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:54.588828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:54.589464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:54.595374 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:54.595853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:54.596291 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:54.596972 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:54.597423 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:54.597847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:54.657553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:54.665941 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2aeb6504-d28a-4cb1-a377-499cf896ce9e tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081130 Sep 01 08:58:54.666538 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2797/5568] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:54 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:55.687686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:55.688288 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:55.694949 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:55.695419 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:55.695847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:55.696515 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:55.696957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:55.697369 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:55.755521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:55.763633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-41d0dc70-0844-491e-a9fc-0453d0327908 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079785 Sep 01 08:58:55.764183 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2772/5569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:55 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:56.785001 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:56.785635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:56.792311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:56.792787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:56.793213 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:56.793886 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:56.794366 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:56.794787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:56.854657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:56.862132 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0e8950ce-c5f9-4efa-8b02-a7a081c23b06 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080979 Sep 01 08:58:56.862724 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2798/5570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:56 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:57.883154 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:57.883781 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:57.889679 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:57.890158 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:57.890626 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:57.891310 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:57.891759 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:57.892181 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:57.953696 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:57.962027 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-fb66d655-9c8f-4f34-b9b7-e162e658b9b6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083328 Sep 01 08:58:57.962627 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2773/5571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:57 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:58:58.983047 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:58:58.983643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:58:58.989651 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:58.990136 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:58.990609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:58.991296 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:58:58.991752 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:58:58.992177 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:58:59.054707 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:58:59.063066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a2a3553f-05c1-4cdd-8e69-94afbed24b2b tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083735 Sep 01 08:58:59.063645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2799/5572] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:58:58 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:00.083362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:00.083951 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:00.090497 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:00.090973 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:00.091403 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:00.092066 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:00.092509 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:00.092922 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:00.152557 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:00.159920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-673b1c6e-9b90-48d2-9cb1-946810409475 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080399 Sep 01 08:59:00.160469 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2774/5573] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:00 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:01.179570 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:01.180200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:01.186034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:01.186534 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:01.186960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:01.187629 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:01.188069 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:01.188483 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:01.247216 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:01.254299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-d79f73b6-6bef-4839-8c10-92a19f9dd581 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078740 Sep 01 08:59:01.254898 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2800/5574] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:01 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:02.274630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:02.275232 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:02.281129 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:02.281602 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:02.282032 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:02.282724 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:02.283168 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:02.283580 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:02.346459 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:02.354538 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-20022773-a76a-492c-a8a0-405ed5320ac0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083819 Sep 01 08:59:02.355090 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2775/5575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:02 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:03.375252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:03.375857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:03.381960 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:03.383155 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:03.383609 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:03.384279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:03.384722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:03.385139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:03.443675 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:03.452083 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a6091060-8b1a-4745-8524-389e6ae0d4b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080650 Sep 01 08:59:03.452673 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2801/5576] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:03 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:04.472648 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:04.473257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:04.479376 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:04.479859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:04.480293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:04.480972 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:04.481423 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:04.481847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:04.540754 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:04.548542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-858b4e24-fd29-42e3-b6f0-3c268260dbf7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079759 Sep 01 08:59:04.549095 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2776/5577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:04 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:05.568737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:05.569349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:05.575324 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:05.575803 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:05.576234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:05.576935 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:05.577353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:05.578058 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:05.638391 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:05.645857 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-47720281-f34c-4b9d-b444-a3165eb4c805 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080952 Sep 01 08:59:05.646431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2802/5578] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:05 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:06.666865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:06.667394 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:06.669298 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:06.674655 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:06.675132 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:06.675563 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:06.676242 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:06.676688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:06.677105 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:06.679774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:06.738157 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:06.745726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-15cec90b-09d2-4168-b517-c4eb9287f132 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082762 Sep 01 08:59:06.746293 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2777/5579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:06 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:07.765911 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:07.766482 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:07.768417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:07.773813 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:07.774316 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:07.774747 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:07.775421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:07.775863 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:07.776279 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:07.779045 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:07.836767 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:07.844169 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9f2a286d-e500-47a7-8d0e-19b419a9e218 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082123 Sep 01 08:59:07.844721 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2803/5580] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:07 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:08.864250 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:08.864859 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:08.871575 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:08.872054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:08.872487 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:08.873165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:08.873610 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:08.874031 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:08.932968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:08.940544 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-1f118676-2276-4537-ba7a-05fe631a741d tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080079 Sep 01 08:59:08.941104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2778/5581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:08 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:09.959890 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:09.961165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:09.967157 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:09.967639 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:09.968068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:09.968739 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:09.969185 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:09.969605 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:10.027908 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:10.035475 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bd2a6cfd-d592-4a41-aef7-34c198a92878 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079421 Sep 01 08:59:10.036034 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2804/5582] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:09 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:11.056065 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:11.056661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:11.062535 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:11.063007 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:11.063436 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:11.064118 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:11.064543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:11.064955 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:11.126227 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:11.134693 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-b5c37ec1-552f-41af-8557-16d758b2087a tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082577 Sep 01 08:59:11.135494 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2779/5583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:11 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:12.155722 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:12.156370 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:12.162181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:12.162702 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:12.163643 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:12.164328 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:12.164782 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:12.165207 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:12.224420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:12.232757 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4c158671-cabb-44db-b6c6-281dbabd1d57 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080902 Sep 01 08:59:12.233349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2805/5584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:12 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:13.253744 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:13.254353 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:13.260302 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:13.260774 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:13.261201 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:13.261865 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:13.262340 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:13.262755 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:13.321914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:13.329309 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f105113b-9cbf-4a74-b330-04739e01a5ce tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079369 Sep 01 08:59:13.329861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2780/5585] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:13 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:14.350303 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:14.351598 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:14.357521 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:14.358000 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:14.358466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:14.359148 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:14.359619 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:14.360025 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:14.418389 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:14.426156 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-429c1f8b-756d-4978-b2c7-6f5a52ebe12f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079731 Sep 01 08:59:14.426745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2806/5586] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:14 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:15.448652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:15.449998 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:15.456664 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:15.457240 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:15.457706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:15.458505 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:15.459009 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:15.459525 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:15.520466 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:15.528078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-0f40267b-3a4f-4cc9-9c23-d345e0f34fa0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083358 Sep 01 08:59:15.528633 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2781/5587] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:15 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:16.548427 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:16.549067 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:16.555010 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:16.555488 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:16.555919 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:16.557200 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:16.557646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:16.558068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:16.615979 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:16.624068 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a85523e2-92b9-4afb-a669-4c58280eab09 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079739 Sep 01 08:59:16.624620 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2807/5588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:16 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:17.644712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:17.645321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:17.651558 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:17.652043 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:17.652479 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:17.653165 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:17.653618 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:17.654044 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:17.712925 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:17.720364 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-8a3047e1-012a-4cf1-b40f-39b5b63fab99 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079494 Sep 01 08:59:17.720968 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2782/5589] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:17 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:18.740717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:18.741247 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:18.747240 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:18.747715 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:18.748143 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:18.748810 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:18.749252 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:18.749665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:18.808414 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:18.815842 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bb6a9234-ca84-41f6-bf5b-a3b5a339db53 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078996 Sep 01 08:59:18.816390 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2808/5590] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:18 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:19.836671 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:19.837316 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:19.843218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:19.843688 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:19.844115 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:19.844779 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:19.845221 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:19.845643 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:19.906936 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:19.914449 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-64ab8927-10ea-4c34-93d6-fb95493c4bb5 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081540 Sep 01 08:59:19.915019 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2783/5591] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:19 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:20.935671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:20.936273 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:20.942166 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:20.942664 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:20.943088 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:20.943787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:20.944233 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:20.944646 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:21.002968 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:21.011353 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4d92ea88-0c9a-4b1a-bde5-5f37f257f884 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079490 Sep 01 08:59:21.011912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2809/5592] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:20 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:22.030861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:22.031462 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:22.037387 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:22.037861 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:22.038307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:22.038979 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:22.039420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:22.039832 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:22.098863 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:22.106502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-96b248e6-55ec-4912-ba41-c189921687a9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079362 Sep 01 08:59:22.107056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2784/5593] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:22 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:23.126492 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:23.127091 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:23.132963 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:23.133435 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:23.133860 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:23.134586 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:23.135028 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:23.135442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:23.193988 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:23.201726 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-2ff4835a-5fe0-4527-b752-1d116dfe76b8 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079142 Sep 01 08:59:23.202297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2810/5594] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:23 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:24.221630 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:24.222228 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:24.228746 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:24.229218 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:24.229641 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:24.230338 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:24.230784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:24.231204 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:24.292407 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:24.300153 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-94dae542-05fc-409c-906f-b69efe70792f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082299 Sep 01 08:59:24.300706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2785/5595] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:24 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:25.320352 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:25.320934 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:25.323415 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:59:25.323557 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:59:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 (ip 10.222.0.43) !!! Sep 01 08:59:25.334349 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:25.334828 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:25.335260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:25.335967 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:25.336417 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:25.336835 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:25.395884 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:25.404161 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-c5bd499e-e95e-4c95-ba81-dc7e21fcd5d6 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.087646 Sep 01 08:59:25.404717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2811/5596] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:25 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:26.424656 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:26.425279 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:26.431906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:26.432391 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:26.432842 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:26.433502 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:26.433975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:26.434661 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:26.500833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:26.510148 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-01f6b21e-6afe-4ff4-9a2f-04e2a65d6a4c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.089366 Sep 01 08:59:26.514530 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2786/5597] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:26 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:27.530688 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:27.531297 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:27.537184 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:27.537657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:27.538086 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:27.538789 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:27.539236 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:27.539654 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:27.598744 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:27.606650 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e8a8ab82-91a2-48db-8e70-0f69d89c34a4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079742 Sep 01 08:59:27.607206 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2812/5598] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:27 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:28.628808 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:28.629409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:28.635977 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:28.636451 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:28.636875 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:28.637549 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:28.637990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:28.638433 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:28.699976 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:28.707370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-85811820-6752-4701-b18e-87e59aee6be3 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082397 Sep 01 08:59:28.707920 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2787/5599] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:28 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:59:29.726861 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:29.727400 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:29.733918 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:29.734421 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:29.734847 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:29.735523 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:29.735965 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:29.736378 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:29.795446 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:29.803223 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-ac4e68cd-80c9-460a-ae18-501a1887a97f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080178 Sep 01 08:59:29.803779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2813/5600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:29 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:30.824005 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:30.824603 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:30.830518 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:30.830994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:30.831421 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:30.832104 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:30.832534 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:30.832950 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:30.891265 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:30.898728 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-467a3ed2-e3c6-4eb6-9c3a-08823c6542b9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078583 Sep 01 08:59:30.899303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2788/5601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:30 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:31.920256 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:31.920856 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:31.926993 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:31.927463 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:31.927887 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:31.928554 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:31.928995 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:31.929409 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:31.987667 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:31.995208 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-6f5e17a7-68b6-4f72-872d-fb79733f1f3c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079335 Sep 01 08:59:31.995763 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2814/5602] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:31 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:33.015108 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:33.015742 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:33.021638 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:33.022116 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:33.022577 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:33.023257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:33.023706 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:33.024127 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:33.087205 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:33.095498 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-17ff11fe-1203-4aed-87d9-cb3cb6743649 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084172 Sep 01 08:59:33.096056 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2789/5603] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:33 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:34.115713 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:34.116320 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:34.123003 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:34.123480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:34.123912 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:34.124592 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:34.125044 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:34.125464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:34.186012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:34.193553 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-796fb89b-6e39-48b4-9da8-3b1710e22e27 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081673 Sep 01 08:59:34.194108 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2815/5604] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:34 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:35.212879 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:35.214146 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:35.220054 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:35.220527 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:35.220957 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:35.221631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:35.222078 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:35.222526 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:35.281389 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:35.288831 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-c92c339f-0a20-4ac6-9563-14f34ec1d745 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079805 Sep 01 08:59:35.289385 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2790/5605] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:35 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:36.309476 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:36.310080 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:36.315928 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:36.316405 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:36.316838 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:36.317510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:36.317952 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:36.318395 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:36.378082 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:36.386211 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-e2309493-54a9-42bd-9b4f-c002a8c251fd tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081218 Sep 01 08:59:36.386779 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2816/5606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:36 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:37.407086 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:37.407673 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:37.409507 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_api:SELECT=28 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:37.414634 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:37.415110 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:37.415543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:37.416417 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:37.416868 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:37.417289 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:37.421307 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG dbcounter [-] [120752] Writing DB stats nova_cell1:SELECT=84 {{(pid=120752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:37.480010 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:37.487548 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-6ab865b2-0afd-410f-874c-1636c65a467c tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.084289 Sep 01 08:59:37.488100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2791/5607] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:37 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:38.507817 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:38.508455 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:38.510319 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=28 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:38.515466 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:38.515947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:38.516387 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:38.517066 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:38.517514 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:38.517958 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:38.520657 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=84 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:38.578325 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:38.585834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-568e5d89-89f7-48d9-adac-ee3c95a7f001 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081878 Sep 01 08:59:38.586410 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2817/5608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:38 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:39.606695 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:39.607294 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:39.613281 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:39.613753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:39.614177 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:39.614873 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:39.615313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:39.615726 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:39.674990 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:39.683199 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-e57d8e8d-7e82-47de-9777-8bc93c92e967 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.081108 Sep 01 08:59:39.683766 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2792/5609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:39 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:40.702949 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:40.703563 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:40.709561 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:40.710042 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:40.710519 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:40.711198 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:40.711649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:40.712073 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:40.771012 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:40.779186 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-722299d9-e55a-4555-abaf-48a891598c4f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080064 Sep 01 08:59:40.779737 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2818/5610] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:40 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:41.800542 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:41.801140 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:41.807680 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:41.808260 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:41.808749 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:41.809456 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:41.809914 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:41.810362 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:41.871190 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:41.878753 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-f2e05189-cafe-40da-8eff-39869324d2c9 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082181 Sep 01 08:59:41.879257 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2793/5611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:41 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:42.898894 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:42.899505 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:42.906005 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:42.906510 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:42.906947 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:42.907624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:42.908076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:42.908497 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:42.966946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:42.974480 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-5ace81c6-2c75-4edc-99d3-676f072af4e1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079392 Sep 01 08:59:42.975039 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2819/5612] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:42 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:43.994780 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:43.995356 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:44.001370 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:44.001847 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:44.002301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:44.002981 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:44.003425 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:44.003841 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:44.063948 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:44.071521 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-18985141-0cfd-4034-828b-0efaffa38cee tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080859 Sep 01 08:59:44.072072 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2794/5613] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:43 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:45.092733 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:45.093339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:45.099190 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:45.099671 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:45.100103 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:45.100778 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:45.101234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:45.101652 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:45.163174 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:45.170649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-4bc41c8f-1bc8-4677-926c-4bc89ec1fc13 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082240 Sep 01 08:59:45.171199 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2820/5614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:45 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:46.191712 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:46.192319 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:46.198496 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:46.198975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:46.199406 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:46.200076 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:46.200523 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:46.200940 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:46.262700 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:46.270333 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-ad670a1c-96b9-47b4-b5ae-a00775b414d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082450 Sep 01 08:59:46.270892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2795/5615] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:46 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:47.292038 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:47.292640 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:47.298748 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:47.299222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:47.299649 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:47.300322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:47.300762 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:47.301181 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:47.359394 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:47.366745 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-9eb733c9-a918-411b-a7f3-6b99968b650f tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079053 Sep 01 08:59:47.367301 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2821/5616] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:47 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:48.387906 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:48.388543 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:48.394516 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:48.394994 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:48.395422 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:48.396100 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:48.396546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:48.396967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:48.456598 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:48.465975 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4090e880-2ab6-4577-a97f-db5c4687a7e7 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082441 Sep 01 08:59:48.466562 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2796/5617] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:48 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:49.485793 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:49.486443 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:49.492613 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:49.493093 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:49.493522 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:49.494234 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:49.495464 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:49.495985 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:49.554165 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:49.562420 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-21aa9077-2710-4a34-8376-2f1a84b8f6a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080273 Sep 01 08:59:49.562980 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2822/5618] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:49 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:50.582657 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:50.583263 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:50.589341 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:50.589816 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:50.590247 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:50.590943 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:50.591392 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:50.591813 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:50.653455 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:50.661111 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-560d40fd-916a-42e9-852b-654c29cee0a0 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.082216 Sep 01 08:59:50.661734 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2797/5619] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:50 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:51.680924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:51.681533 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:51.687645 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:51.688123 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:51.688555 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:51.689232 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:51.689683 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:51.690106 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:51.749076 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:51.756580 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-0fc5dc7b-1a18-4c84-8ac5-aafd88c71225 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.079544 Sep 01 08:59:51.757134 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2823/5620] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:51 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 08:59:52.777717 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:52.778241 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:52.780266 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:59:52.780408 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 (ip 10.222.0.43) !!! Sep 01 08:59:52.782277 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:59:52.782409 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Thu Sep 1 08:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 (ip 10.222.0.43) !!! Sep 01 08:59:52.796956 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:52.797686 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:52.798113 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:52.798829 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:52.799303 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:52.799714 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:52.858959 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:52.866898 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-bd9353ad-5027-44c7-a415-444d19e132cb tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.093870 Sep 01 08:59:52.867453 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2798/5621] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:52 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:53.887137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:53.887742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:53.889665 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 08:59:53.889807 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 08:59:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 (ip 10.222.0.43) !!! Sep 01 08:59:53.895834 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:53.896311 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:53.896742 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:53.897429 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:53.897880 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:53.898326 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:53.959442 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:53.967019 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-bcdd1a9b-0558-49e7-8b36-171796cfbad1 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083774 Sep 01 08:59:53.967568 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2824/5622] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:53 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:54.987884 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:54.988546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:54.995018 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:54.995850 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:54.996171 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:54.996849 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:54.997301 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:54.997725 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:55.059889 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:55.067450 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-828c93e8-166b-4333-81a5-f3a26f032bd4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083481 Sep 01 08:59:55.068001 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2799/5623] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:54 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:56.089269 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:56.089924 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:56.095853 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:56.096329 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:56.096756 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:56.097431 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:56.097873 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:56.098306 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:56.156946 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:56.164398 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-90b7a92d-b168-4547-afa4-2d64d0ce06bf tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.080002 Sep 01 08:59:56.164948 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2825/5624] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:56 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:57.184819 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:57.185420 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:57.191269 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:57.191741 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:57.192169 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:57.192833 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:57.193276 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:57.193694 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:57.251967 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:57.259635 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-86734d41-0b07-41a8-ad4f-7295d8e02b88 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.078679 Sep 01 08:59:57.260313 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2800/5625] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:57 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:58.280717 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:58.281322 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:58.287655 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:58.288131 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:58.288612 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:58.289293 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:58.289735 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:58.290153 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:58.359251 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.policy [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120753) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:58.367582 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-8f41379c-c78e-4e34-94da-27ff63ab23ea tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.090677 Sep 01 08:59:58.368222 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2826/5626] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:58 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:59.388631 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:59.389305 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:59.395069 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:59.395546 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:59.395982 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:59.396652 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:59.397101 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:59.397519 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:59.460576 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.policy [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3979dd9da28948c584d0eabbc7ef9559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080a584184d2447bad65232e948ee0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120752) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 08:59:59.468122 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-4c8c369f-0fe7-4a2e-8a4b-f82bdc7846d4 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 200 len: 1145 microversion: 2.1 time: 0.083898 Sep 01 08:59:59.468733 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2801/5627] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:59 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 08:59:59.487141 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:59.487624 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120753) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:59.493531 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:59.494014 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:59.494485 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:59.495698 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:59.496147 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:59.496573 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:59.521139 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.compute.api [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Going to try to terminate instance {{(pid=120753) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 08:59:59.530085 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:59.530660 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:59.531094 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG oslo_concurrency.lockutils [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:59.543264 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lazy-loading 'flavor' on Instance uuid 13a6b89e-93ee-4b68-82a9-858990bbf721 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:59:59.554339 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lazy-loading 'system_metadata' on Instance uuid 13a6b89e-93ee-4b68-82a9-858990bbf721 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:59:59.570315 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.objects.instance [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lazy-loading 'metadata' on Instance uuid 13a6b89e-93ee-4b68-82a9-858990bbf721 {{(pid=120753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 08:59:59.737299 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.scheduler.client.report [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Deleted allocations for instance 13a6b89e-93ee-4b68-82a9-858990bbf721 Sep 01 08:59:59.754137 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-13c1c6a6-02de-44a6-a26a-5b474500c159 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "DELETE /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 204 len: 0 microversion: 2.1 time: 0.270827 Sep 01 08:59:59.754953 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2827/5628] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Sep 1 08:59:59 2022] DELETE /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 08:59:59.763892 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '>' {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 08:59:59.764501 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.compute.api [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] [instance: 13a6b89e-93ee-4b68-82a9-858990bbf721] Fetching instance by UUID {{(pid=120752) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 08:59:59.770321 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:59.770803 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:59.771237 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:59.771915 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Acquiring lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 08:59:59.772365 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 08:59:59.772784 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG oslo_concurrency.lockutils [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Lock "68db8b0b-4cf2-486d-b60d-ca583ee6448a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 08:59:59.785885 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.wsgi [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] HTTP exception thrown: Instance 13a6b89e-93ee-4b68-82a9-858990bbf721 could not be found. Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Request method failure captured: Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: request: GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 HTTP/1.1 Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept: application/json Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Accept-Encoding: identity Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Connection: close Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Length: 0 Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Content-Type: application/json Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Host: 10.222.0.43 Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: Openstack-System-Scope: None Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: User-Agent: python-urllib3/1.26.12 Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Auth-Token: gAAAAABjEHMSSwB5v-TXNk-JGJF_K-bgIaEQOw9woN9thbyF4mvLasBrOMDAXpWQryt83nFpp_ma9L_WEKz7KKCjIQZjJivJRxsBVl-0DPORaGSC2YgN2c0j_932buhMj7LujULERCToN-mFjsgAaTGIxJio0WcznHpsoA8u9Wc-mW4zaloiIao Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Id: None Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Domain-Name: None Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Identity-Status: Confirmed Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Is-Admin-Project: True Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Id: default Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Domain-Name: Default Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Id: 080a584184d2447bad65232e948ee0e0 Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Project-Name: tempest-TestVolumeBootPattern-908616382 Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Role: reader,member Sep 01 08:59:59.787440 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Roles: reader,member Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/080a584184d2447bad65232e948ee0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/080a584184d2447bad65232e948ee0e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_080a584184d2447bad65232e948ee0e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/080a584184d2447bad65232e948ee0e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant: tempest-TestVolumeBootPattern-908616382 Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Id: 080a584184d2447bad65232e948ee0e0 Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-Tenant-Name: tempest-TestVolumeBootPattern-908616382 Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User: tempest-TestVolumeBootPattern-908616382-project Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Id: default Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Domain-Name: Default Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Id: 3979dd9da28948c584d0eabbc7ef9559 Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: X-User-Name: tempest-TestVolumeBootPattern-908616382-project Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: method: > Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: exception: Instance 13a6b89e-93ee-4b68-82a9-858990bbf721 could not be found. Sep 01 08:59:59.788999 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: action_args: {'id': '13a6b89e-93ee-4b68-82a9-858990bbf721'} Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: {{(pid=120752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a6b89e-93ee-4b68-82a9-858990bbf721 could not be found. Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 08:59:59.790149 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a6b89e-93ee-4b68-82a9-858990bbf721 could not be found. Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a6b89e-93ee-4b68-82a9-858990bbf721 could not be found. Sep 01 08:59:59.791401 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: ERROR nova.api.openstack.wsgi Sep 01 08:59:59.793179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: DEBUG nova.api.openstack.wsgi [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Returning 404 to user: Instance 13a6b89e-93ee-4b68-82a9-858990bbf721 could not be found. {{(pid=120752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 08:59:59.793179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: INFO nova.api.openstack.requestlog [None req-949a1524-656e-4210-bcfc-66aa9a192528 tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721" status: 404 len: 111 microversion: 2.1 time: 0.029634 Sep 01 08:59:59.793179 dv-cinder-855479-1-iscsi devstack@n-api.service[120752]: [pid: 120752|app: 0|req: 2802/5629] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Sep 1 08:59:59 2022] GET /compute/v2.1/servers/13a6b89e-93ee-4b68-82a9-858990bbf721 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:05:59.676396 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:05:59.677274 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG dbcounter [-] [120753] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:05:59.678635 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 09:05:59.678854 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 09:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1087839153 (ip 10.222.0.43) !!! Sep 01 09:05:59.679881 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 09:05:59.679986 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: Thu Sep 1 09:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1087839153 (ip 10.222.0.43) !!! Sep 01 09:05:59.684260 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: DEBUG nova.api.openstack.wsgi [None req-a7e6cf59-4f20-476d-91b8-8d777947c3cc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] Calling method '.version_select at 0x7f2abf063310>' {{(pid=120753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:05:59.722154 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: INFO nova.api.openstack.requestlog [None req-a7e6cf59-4f20-476d-91b8-8d777947c3cc tempest-TestVolumeBootPattern-908616382 tempest-TestVolumeBootPattern-908616382-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1087839153" status: 202 len: 0 microversion: 2.1 time: 0.047247 Sep 01 09:05:59.722787 dv-cinder-855479-1-iscsi devstack@n-api.service[120753]: [pid: 120753|app: 0|req: 2828/5630] 10.222.0.43 () {58 vars in 1263 bytes} [Thu Sep 1 09:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1087839153 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)